CNN Classification with Data Augmentation

Image Classification

In this project, you'll classify images from the CIFAR-10 dataset. The dataset consists of airplanes, dogs, cats, and other objects. You'll preprocess the images, then train a convolutional neural network on all the samples. The images need to be normalized and the labels need to be one-hot encoded. You'll get to apply what you learned and build a convolutional, max pooling, dropout, and fully connected layers. At the end, you'll get to see your neural network's predictions on the sample images.

Load nessecerry modules

In [ ]:
!pip install tqdm
In [1]:
import os, tarfile, random, pickle
from unittest.mock import MagicMock
from urllib.request import urlretrieve
from os.path import isfile, isdir
from tqdm import tqdm
import numpy as np
import tensorflow as tf
import matplotlib.pyplot as plt
from sklearn.preprocessing import LabelBinarizer
import imgaug as ia
from imgaug import augmenters as iaa
import numpy as np
import math
In [2]:
def _load_label_names():
    """
    Load the label names from file
    """
    return ['airplane', 'automobile', 'bird', 'cat', 'deer', 'dog', 'frog', 'horse', 'ship', 'truck']


def load_cfar10_batch(cifar10_dataset_folder_path, batch_id):
    """
    Load a batch of the dataset
    """
    with open(cifar10_dataset_folder_path + '/data_batch_' + str(batch_id), mode='rb') as file:
        batch = pickle.load(file, encoding='latin1')

    features = batch['data'].reshape((len(batch['data']), 3, 32, 32)).transpose(0, 2, 3, 1)
    labels = batch['labels']

    return features, labels

def load_train_batch(cifar10_dataset_folder_path, batch_id):
    with open(cifar10_dataset_folder_path + '/train_batch_' + str(batch_id), mode='rb') as file:
        batch = pickle.load(file)
        
    features,labels=batch
    
    return features, labels

def load_validation(cifar10_dataset_folder_path):
    with open(cifar10_dataset_folder_path + '/validation', mode='rb') as file:
        validation = pickle.load(file)
        
    features,labels=validation

    return features, labels

def load_aug_batch(cifar10_dataset_folder_path, batch_id):

    with open(cifar10_dataset_folder_path + '/aug_data_batch_' + str(batch_id), mode='rb') as file:
        batch = pickle.load(file)
        
    features,labels=batch

    return features, labels

def display_stats(cifar10_dataset_folder_path, batch_id, sample_id):
    """
    Display Stats of the the dataset
    """
    batch_ids = list(range(1, 6))

    if batch_id not in batch_ids:
        print('Batch Id out of Range. Possible Batch Ids: {}'.format(batch_ids))
        return None

    features, labels = load_cfar10_batch(cifar10_dataset_folder_path, batch_id)

    if not (0 <= sample_id < len(features)):
        print('{} samples in batch {}.  {} is out of range.'.format(len(features), batch_id, sample_id))
        return None

    print('\nStats of batch {}:'.format(batch_id))
    print('Samples: {}'.format(len(features)))
    print('Label Counts: {}'.format(dict(zip(*np.unique(labels, return_counts=True)))))
    print('First 20 Labels: {}'.format(labels[:20]))

    sample_image = features[sample_id]
    sample_label = labels[sample_id]
    label_names = _load_label_names()

    print('\nExample of Image {}:'.format(sample_id))
    print('Image - Min Value: {} Max Value: {}'.format(sample_image.min(), sample_image.max()))
    print('Image - Shape: {}'.format(sample_image.shape))
    print('Label - Label Id: {} Name: {}'.format(sample_label, label_names[sample_label]))
    plt.axis('off')
    plt.imshow(sample_image)


def _preprocess_and_save(normalize, one_hot_encode, features, labels, filename):
    """
    Preprocess data and save it to file
    """
    features = normalize(features)
    labels = one_hot_encode(labels)

    pickle.dump((features, labels), open(filename, 'wb'))

def random_shuffle_split(cifar10_dataset_folder_path):
    
    n_batches = 5
    valid_features = []
    valid_labels = []
    
    for batch_i in range(1, n_batches + 1):
        
        features, labels = load_cfar10_batch(cifar10_dataset_folder_path, batch_i)
        
        indices = np.arange(features.shape[0])
        np.random.shuffle(indices)
        features = features[indices]
        labels = np.array(labels)[indices].tolist()
        
        validation_count = int(len(features) * 0.1)
            
        # save a batch of training data
        pickle.dump((features[:-validation_count], labels[:-validation_count]), 
                    open(cifar10_dataset_folder_path+'/train_batch_' + str(batch_i), 'wb'))
        
        # Use a portion of training batch for validation
        valid_features.extend(features[-validation_count:])
        valid_labels.extend(labels[-validation_count:])
        
    # Save all validation data
    pickle.dump((valid_features, valid_labels), open(cifar10_dataset_folder_path+'/validation', 'wb'))

def preprocess_and_save_data(cifar10_dataset_folder_path, normalize, one_hot_encode, aug):
    """
    Preprocess Training and Validation Data
    """
    n_batches = 5
    valid_features = []
    valid_labels = []
    new_batch_i = 1
    
    for batch_i in range(1, n_batches + 1):
        
        features, labels = load_train_batch(cifar10_dataset_folder_path, batch_i)
        if aug==True:
            aug_features, aug_labels = load_aug_batch(cifar10_dataset_folder_path, batch_i)
            features=np.concatenate([features,aug_features])
            labels.extend(aug_labels)
        indices = np.arange(features.shape[0])
        np.random.shuffle(indices)
        features = features[indices]
        labels = np.array(labels)[indices].tolist()
        l=int(len(features)/10)
        for i in range(0,10):
            
            # Prprocess and save a batch of training data
            _preprocess_and_save(
                normalize,
                one_hot_encode,
                features[i*l:(i+1)*l],
                labels[i*l:(i+1)*l],
                'preprocess_batch_' + str(new_batch_i) + '.p')

            new_batch_i = new_batch_i + 1
    
    valid_features, valid_labels = load_validation(cifar10_dataset_folder_path)
    # Preprocess and Save all validation data
    _preprocess_and_save(
        normalize,
        one_hot_encode,
        np.array(valid_features),
        np.array(valid_labels),
        'preprocess_validation.p')
    
    with open(cifar10_dataset_folder_path + '/test_batch', mode='rb') as file:
        batch = pickle.load(file, encoding='latin1')

    # load the test data
    test_features = batch['data'].reshape((len(batch['data']), 3, 32, 32)).transpose(0, 2, 3, 1)
    test_labels = batch['labels']

    # Preprocess and Save all test data
    _preprocess_and_save(
        normalize,
        one_hot_encode,
        np.array(test_features),
        np.array(test_labels),
        'preprocess_test.p')


def batch_features_labels(features, labels, batch_size):
    """
    Split features and labels into batches
    """
    for start in range(0, len(features), batch_size):
        end = min(start + batch_size, len(features))
        yield features[start:end], labels[start:end]


def load_preprocess_training_batch(batch_id, batch_size):
    """
    Load the Preprocessed Training data and return them in batches of <batch_size> or less
    """
    filename = 'preprocess_batch_' + str(batch_id) + '.p'
    features, labels = pickle.load(open(filename, mode='rb'))

    # Return the training data in batches of size <batch_size> or less
    return batch_features_labels(features, labels, batch_size)


def display_image_predictions(features, labels, predictions):
    n_classes = 10
    label_names = _load_label_names()
    label_binarizer = LabelBinarizer()
    label_binarizer.fit(range(n_classes))
    label_ids = label_binarizer.inverse_transform(np.array(labels))

    fig, axies = plt.subplots(nrows=4, ncols=2)
    fig.tight_layout()
    fig.suptitle('Softmax Predictions', fontsize=20, y=1.1)

    n_predictions = 3
    margin = 0.05
    ind = np.arange(n_predictions)
    width = (1. - 2. * margin) / n_predictions

    for image_i, (feature, label_id, pred_indicies, pred_values) in enumerate(zip(features, label_ids, predictions.indices, predictions.values)):
        pred_names = [label_names[pred_i] for pred_i in pred_indicies]
        correct_name = label_names[label_id]

        axies[image_i][0].imshow(feature)
        axies[image_i][0].set_title(correct_name)
        axies[image_i][0].set_axis_off()

        axies[image_i][1].barh(ind + margin, pred_values[::-1], width)
        axies[image_i][1].set_yticks(ind + margin)
        axies[image_i][1].set_yticklabels(pred_names[::-1])
        axies[image_i][1].set_xticks([0, 0.5, 1.0])
In [3]:
def _print_success_message():
    print('Tests Passed')


def test_folder_path(cifar10_dataset_folder_path):
    assert cifar10_dataset_folder_path is not None,\
        'Cifar-10 data folder not set.'
    assert cifar10_dataset_folder_path[-1] != '/',\
        'The "/" shouldn\'t be added to the end of the path.'
    assert os.path.exists(cifar10_dataset_folder_path),\
        'Path not found.'
    assert os.path.isdir(cifar10_dataset_folder_path),\
        '{} is not a folder.'.format(os.path.basename(cifar10_dataset_folder_path))

    train_files = [cifar10_dataset_folder_path + '/data_batch_' + str(batch_id) for batch_id in range(1, 6)]
    other_files = [cifar10_dataset_folder_path + '/batches.meta', cifar10_dataset_folder_path + '/test_batch']
    missing_files = [path for path in train_files + other_files if not os.path.exists(path)]

    assert not missing_files,\
        'Missing files in directory: {}'.format(missing_files)

    print('All files found!')


def test_normalize(normalize):
    test_shape = (np.random.choice(range(1000)), 32, 32, 3)
    test_numbers = np.random.choice(range(256), test_shape)
    normalize_out = normalize(test_numbers)

    assert type(normalize_out).__module__ == np.__name__,\
        'Not Numpy Object'

    assert normalize_out.shape == test_shape,\
        'Incorrect Shape. {} shape found'.format(normalize_out.shape)

    assert normalize_out.max() <= 1 and normalize_out.min() >= 0,\
        'Incorect Range. {} to {} found'.format(normalize_out.min(), normalize_out.max())

    _print_success_message()


def test_one_hot_encode(one_hot_encode):
    test_shape = np.random.choice(range(1000))
    test_numbers = np.random.choice(range(10), test_shape)
    one_hot_out = one_hot_encode(test_numbers)

    assert type(one_hot_out).__module__ == np.__name__,\
        'Not Numpy Object'

    assert one_hot_out.shape == (test_shape, 10),\
        'Incorrect Shape. {} shape found'.format(one_hot_out.shape)

    n_encode_tests = 5
    test_pairs = list(zip(test_numbers, one_hot_out))
    test_indices = np.random.choice(len(test_numbers), n_encode_tests)
    labels = [test_pairs[test_i][0] for test_i in test_indices]
    enc_labels = np.array([test_pairs[test_i][1] for test_i in test_indices])
    new_enc_labels = one_hot_encode(labels)

    assert np.array_equal(enc_labels, new_enc_labels),\
        'Encodings returned different results for the same numbers.\n' \
        'For the first call it returned:\n' \
        '{}\n' \
        'For the second call it returned\n' \
        '{}\n' \
        'Make sure you save the map of labels to encodings outside of the function.'.format(enc_labels, new_enc_labels)

    _print_success_message()


def test_nn_image_inputs(neural_net_image_input):
    image_shape = (32, 32, 3)
    nn_inputs_out_x = neural_net_image_input(image_shape)

    assert nn_inputs_out_x.get_shape().as_list() == [None, image_shape[0], image_shape[1], image_shape[2]],\
        'Incorrect Image Shape.  Found {} shape'.format(nn_inputs_out_x.get_shape().as_list())

    assert nn_inputs_out_x.op.type == 'Placeholder',\
        'Incorrect Image Type.  Found {} type'.format(nn_inputs_out_x.op.type)

    assert nn_inputs_out_x.name == 'x:0', \
        'Incorrect Name.  Found {}'.format(nn_inputs_out_x.name)

    print('Image Input Tests Passed.')


def test_nn_label_inputs(neural_net_label_input):
    n_classes = 10
    nn_inputs_out_y = neural_net_label_input(n_classes)

    assert nn_inputs_out_y.get_shape().as_list() == [None, n_classes],\
        'Incorrect Label Shape.  Found {} shape'.format(nn_inputs_out_y.get_shape().as_list())

    assert nn_inputs_out_y.op.type == 'Placeholder',\
        'Incorrect Label Type.  Found {} type'.format(nn_inputs_out_y.op.type)

    assert nn_inputs_out_y.name == 'y:0', \
        'Incorrect Name.  Found {}'.format(nn_inputs_out_y.name)

    print('Label Input Tests Passed.')


def test_nn_keep_prob_inputs(neural_net_keep_prob_input):
    nn_inputs_out_k = neural_net_keep_prob_input()

    assert nn_inputs_out_k.get_shape().ndims is None,\
        'Too many dimensions found for keep prob.  Found {} dimensions.  It should be a scalar (0-Dimension Tensor).'.format(nn_inputs_out_k.get_shape().ndims)

    assert nn_inputs_out_k.op.type == 'Placeholder',\
        'Incorrect keep prob Type.  Found {} type'.format(nn_inputs_out_k.op.type)

    assert nn_inputs_out_k.name == 'keep_prob:0', \
        'Incorrect Name.  Found {}'.format(nn_inputs_out_k.name)

    print('Keep Prob Tests Passed.')


def test_con_pool(conv2d_maxpool):
    test_x = tf.placeholder(tf.float32, [None, 32, 32, 5])
    test_num_outputs = 10
    test_con_k = (2, 2)
    test_con_s = (4, 4)
    test_pool_k = (2, 2)
    test_pool_s = (2, 2)

    conv2d_maxpool_out = conv2d_maxpool(test_x, test_num_outputs, test_con_k, test_con_s, test_pool_k, test_pool_s)

    assert conv2d_maxpool_out.get_shape().as_list() == [None, 4, 4, 10],\
        'Incorrect Shape.  Found {} shape'.format(conv2d_maxpool_out.get_shape().as_list())

    _print_success_message()


def test_flatten(flatten):
    test_x = tf.placeholder(tf.float32, [None, 10, 30, 6])
    flat_out = flatten(test_x)

    assert flat_out.get_shape().as_list() == [None, 10*30*6],\
        'Incorrect Shape.  Found {} shape'.format(flat_out.get_shape().as_list())

    _print_success_message()


def test_fully_conn(fully_conn):
    test_x = tf.placeholder(tf.float32, [None, 128])
    test_num_outputs = 40

    fc_out = fully_conn(test_x, test_num_outputs)

    assert fc_out.get_shape().as_list() == [None, 40],\
        'Incorrect Shape.  Found {} shape'.format(fc_out.get_shape().as_list())

    _print_success_message()


def test_output(output):
    test_x = tf.placeholder(tf.float32, [None, 128])
    test_num_outputs = 40

    output_out = output(test_x, test_num_outputs)

    assert output_out.get_shape().as_list() == [None, 40],\
        'Incorrect Shape.  Found {} shape'.format(output_out.get_shape().as_list())

    _print_success_message()


def test_conv_net(conv_net):
    test_x = tf.placeholder(tf.float32, [None, 32, 32, 3])
    test_k = tf.placeholder(tf.float32)

    logits_out = conv_net(test_x, test_k)

    assert logits_out.get_shape().as_list() == [None, 10],\
        'Incorrect Model Output.  Found {}'.format(logits_out.get_shape().as_list())

    print('Neural Network Built!')


def test_train_nn(train_neural_network):
    mock_session = tf.Session()
    test_x = np.random.rand(128, 32, 32, 3)
    test_y = np.random.rand(128, 10)
    test_k = np.random.rand(1)
    test_optimizer = tf.train.AdamOptimizer()

    mock_session.run = MagicMock()
    train_neural_network(mock_session, test_optimizer, test_k, test_x, test_y)

    assert mock_session.run.called, 'Session not used'

    _print_success_message()

Get the Data

Run the following cell to download the CIFAR-10 dataset for python.

In [4]:
cifar10_dataset_folder_path = 'cifar-10-batches-py' 

class DLProgress(tqdm):
    last_block = 0

    def hook(self, block_num=1, block_size=1, total_size=None):
        self.total = total_size
        self.update((block_num - self.last_block) * block_size)
        self.last_block = block_num

tar_gz_path = 'cifar-10-python.tar.gz'

if not isdir(cifar10_dataset_folder_path):
    if not isfile(tar_gz_path):
        with DLProgress(unit='B', unit_scale=True, miniters=1, desc='CIFAR-10 Dataset') as pbar:
            urlretrieve(
                'https://www.cs.toronto.edu/~kriz/cifar-10-python.tar.gz',
                tar_gz_path,
                pbar.hook)
    with tarfile.open(tar_gz_path) as tar:
        tar.extractall()
        tar.close()

test_folder_path(cifar10_dataset_folder_path)
All files found!

Explore the Data

The dataset is broken into batches to prevent your machine from running out of memory. The CIFAR-10 dataset consists of 5 batches, named data_batch_1, data_batch_2, etc.. Each batch contains the labels and images that are one of the following:

  • airplane
  • automobile
  • bird
  • cat
  • deer
  • dog
  • frog
  • horse
  • ship
  • truck

Understanding a dataset is part of making predictions on the data. Play around with the code cell below by changing the batch_id and sample_id. The batch_id is the id for a batch (1-5). The sample_id is the id for a image and label pair in the batch.

Ask yourself "What are all possible labels?", "What is the range of values for the image data?", "Are the labels in order or random?". Answers to questions like these will help you preprocess the data and end up with better predictions.

In [5]:
%matplotlib inline
%config InlineBackend.figure_format = 'retina'

# Explore the dataset
batch_id = 1
sample_id = 6
display_stats(cifar10_dataset_folder_path, batch_id, sample_id)
Stats of batch 1:
Samples: 10000
Label Counts: {0: 1005, 1: 974, 2: 1032, 3: 1016, 4: 999, 5: 937, 6: 1030, 7: 1001, 8: 1025, 9: 981}
First 20 Labels: [6, 9, 9, 4, 1, 1, 2, 7, 8, 3, 4, 7, 7, 2, 9, 9, 9, 3, 2, 6]

Example of Image 6:
Image - Min Value: 7 Max Value: 249
Image - Shape: (32, 32, 3)
Label - Label Id: 2 Name: bird

Random Shuffle batch data and split into train/validation

In [41]:
random_shuffle_split(cifar10_dataset_folder_path)

Data Augmentation

In [43]:
def aug_image_generation(cifar10_dataset_folder_path, number=9):
    ia.seed(1)

    # Example batch of images.
    n_batches = 5
    #batch_id = 1
    for batch_id in range(1,n_batches+1):

        filename=cifar10_dataset_folder_path + '/aug_data_batch_{}'.format(batch_id)
        features, labels = load_train_batch(cifar10_dataset_folder_path, batch_id)
        labels_aug=np.repeat(labels,number)
        for sample_id in range(len(features)):
        #for sample_id in range(7):
            images = np.array(
              [features[sample_id] for _ in range(number)],
              dtype=np.uint8
            )

            seq = iaa.Sequential([
              iaa.Fliplr(0.5), # horizontal flips
              iaa.Crop(percent=(0, 0.1)), # random crops
              # Small gaussian blur with random sigma between 0 and 0.5.
              # But we only blur about 50% of all images.
              iaa.Sometimes(0.5,
                  iaa.GaussianBlur(sigma=(0, 0.5))
              ),
              # Strengthen or weaken the contrast in each image.
              iaa.ContrastNormalization((0.75, 1.5)),
              # Add gaussian noise.
              # For 50% of all images, we sample the noise once per pixel.
              # For the other 50% of all images, we sample the noise per pixel AND
              # channel. This can change the color (not only brightness) of the
              # pixels.
              iaa.AdditiveGaussianNoise(loc=0, scale=(0.0, 0.05*255), per_channel=0.5),
              # Make some images brighter and some darker.
              # In 20% of all cases, we sample the multiplier once per channel,
              # which can end up changing the color of the images.
              iaa.Multiply((0.8, 1.2), per_channel=0.2),
              # Apply affine transformations to each image.
              # Scale/zoom them, translate/move them, rotate them and shear them.
              iaa.Affine(
                  scale={"x": (0.8, 1.2), "y": (0.8, 1.2)},
                  translate_percent={"x": (-0.2, 0.2), "y": (-0.2, 0.2)},
                  rotate=(-25, 25),
                  shear=(-8, 8)
              )
            ], random_order=True) # apply augmenters in random order
            if sample_id==0:
                images_aug=seq.augment_images(images)
            else:
                images_aug=np.concatenate([images_aug,seq.augment_images(images)])

        print('aug batch {} shape: '.format(batch_id),images_aug.shape)
        pickle.dump((images_aug, labels_aug), open(filename, 'wb'))
In [27]:
def display_aug_image(batch_id,sample_id,number=9):

    filename=cifar10_dataset_folder_path + '/aug_data_batch_{}'.format(batch_id)
    with open(filename, mode='rb') as file:
        aug_batch = pickle.load(file)
    features,labels=aug_batch
    label_names = _load_label_names()
    fig=plt.figure(figsize=(3, 3))
    columns = 3
    rows = math.ceil(number/3)
    j=1
    for i in range(sample_id*number,(sample_id+1)*number):
        image=features[i]
        fig.add_subplot(rows, columns, j)
        plt.axis('off')
        plt.title(label_names[labels[i]])
        plt.imshow(image)
        j=j+1
    plt.show()
In [45]:
aug_image_generation(cifar10_dataset_folder_path, number=9)
aug batch 1 shape:  (81000, 32, 32, 3)
aug batch 2 shape:  (81000, 32, 32, 3)
aug batch 3 shape:  (81000, 32, 32, 3)
aug batch 4 shape:  (81000, 32, 32, 3)
aug batch 5 shape:  (81000, 32, 32, 3)
In [69]:
display_aug_image(1,18)

Implement Preprocess Functions

Normalize

In the cell below, implement the normalize function to take in image data, x, and return it as a normalized Numpy array. The values should be in the range of 0 to 1, inclusive. The return object should be the same shape as x.

In [6]:
def normalize(x):
    """
    Normalize a list of sample image data in the range of 0 to 1
    : x: List of image data.  The image shape is (32, 32, 3)
    : return: Numpy array of normalize data
    """
    # TODO: Implement Function
    norm = (x-x.min())/(x.max()-x.min())
    return norm

"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
test_normalize(normalize)
Tests Passed

One-hot encode

Just like the previous code cell, you'll be implementing a function for preprocessing. This time, you'll implement the one_hot_encode function. The input, x, are a list of labels. Implement the function to return the list of labels as One-Hot encoded Numpy array. The possible values for labels are 0 to 9. The one-hot encoding function should return the same encoding for each value between each call to one_hot_encode. Make sure to save the map of encodings outside the function.

Hint: Don't reinvent the wheel.

In [7]:
def one_hot_encode(x):
    """
    One hot encode a list of sample labels. Return a one-hot encoded vector for each label.
    : x: List of sample Labels
    : return: Numpy array of one-hot encoded labels
    """
    # TODO: Implement Function
    encoding = np.eye(10)[x]
    return encoding

"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
test_one_hot_encode(one_hot_encode)
Tests Passed

Randomize Data

As you saw from exploring the data above, the order of the samples are randomized. It doesn't hurt to randomize it again, but you don't need to for this dataset.

Preprocess all the data and save it

Running the code cell below will preprocess all the CIFAR-10 data and save it to file. The code below also uses 10% of the training data for validation.

In [8]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
# Preprocess Training, Validation, and Testing Data
aug=True
preprocess_and_save_data(cifar10_dataset_folder_path, normalize, one_hot_encode, aug)
Out[8]:
"\nDON'T MODIFY ANYTHING IN THIS CELL\n"

Check Point

This is your first checkpoint. If you ever decide to come back to this notebook or have to restart the notebook, you can start from here. The preprocessed data has been saved to disk.

In [9]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
# Load the Preprocessed Validation data
valid_features, valid_labels = pickle.load(open('preprocess_validation.p', mode='rb'))

Build the network

For the neural network, you'll build each layer into a function. Most of the code you've seen has been outside of functions. To test your code more thoroughly, we require that you put each layer in a function. This allows us to give you better feedback and test for simple mistakes using our unittests before you submit your project.

Note: If you're finding it hard to dedicate enough time for this course each week, we've provided a small shortcut to this part of the project. In the next couple of problems, you'll have the option to use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages to build each layer, except the layers you build in the "Convolutional and Max Pooling Layer" section. TF Layers is similar to Keras's and TFLearn's abstraction to layers, so it's easy to pickup.

However, if you would like to get the most out of this course, try to solve all the problems without using anything from the TF Layers packages. You can still use classes from other packages that happen to have the same name as ones you find in TF Layers! For example, instead of using the TF Layers version of the conv2d class, tf.layers.conv2d, you would want to use the TF Neural Network version of conv2d, tf.nn.conv2d.

Let's begin!

Input

The neural network needs to read the image data, one-hot encoded labels, and dropout keep probability. Implement the following functions

  • Implement neural_net_image_input
    • Return a TF Placeholder
    • Set the shape using image_shape with batch size set to None.
    • Name the TensorFlow placeholder "x" using the TensorFlow name parameter in the TF Placeholder.
  • Implement neural_net_label_input
    • Return a TF Placeholder
    • Set the shape using n_classes with batch size set to None.
    • Name the TensorFlow placeholder "y" using the TensorFlow name parameter in the TF Placeholder.
  • Implement neural_net_keep_prob_input
    • Return a TF Placeholder for dropout keep probability.
    • Name the TensorFlow placeholder "keep_prob" using the TensorFlow name parameter in the TF Placeholder.

These names will be used at the end of the project to load your saved model.

Note: None for shapes in TensorFlow allow for a dynamic size.

In [10]:
def neural_net_input(image_shape, n_classes):
    # Grouping nodes into a single name scope in the computation graph.
    with tf.name_scope('inputs'):
        x = tf.placeholder(tf.float32, [None] + list(image_shape), name='x')
        y = tf.placeholder(tf.float32, [None ,n_classes], name='y')
        keep_prob_1 = tf.placeholder(tf.float32, None, name="keep_prob_1")
        keep_prob_2 = tf.placeholder(tf.float32, None, name="keep_prob_2")
        learning_rate = tf.placeholder(tf.float32, None, "lr")
        is_training=tf.placeholder(tf.bool, None, name='is_training')
    return x, y, keep_prob_1, keep_prob_2, learning_rate, is_training
'''
def neural_net_image_input(image_shape):
    """
    Return a Tensor for a batch of image input
    : image_shape: Shape of the images
    : return: Tensor for image input.
    """
    # TODO: Implement Function
    # usage : tf.placeholder(dtype, shape=None, name=None)
    return tf.placeholder(tf.float32, [None] + list(image_shape), name='x')


def neural_net_label_input(n_classes):
    """
    Return a Tensor for a batch of label input
    : n_classes: Number of classes
    : return: Tensor for label input.
    """
    # TODO: Implement Function
    return tf.placeholder(tf.float32, [None ,n_classes], name='y')


def neural_net_keep_prob_input():
    """
    Return a Tensor for keep probability
    : return: Tensor for keep probability.
    """
    # TODO: Implement Function
    return tf.placeholder(tf.float32, None, name="keep_prob")
'''
Out[10]:
'\ndef neural_net_image_input(image_shape):\n    """\n    Return a Tensor for a batch of image input\n    : image_shape: Shape of the images\n    : return: Tensor for image input.\n    """\n    # TODO: Implement Function\n    # usage : tf.placeholder(dtype, shape=None, name=None)\n    return tf.placeholder(tf.float32, [None] + list(image_shape), name=\'x\')\n\n\ndef neural_net_label_input(n_classes):\n    """\n    Return a Tensor for a batch of label input\n    : n_classes: Number of classes\n    : return: Tensor for label input.\n    """\n    # TODO: Implement Function\n    return tf.placeholder(tf.float32, [None ,n_classes], name=\'y\')\n\n\ndef neural_net_keep_prob_input():\n    """\n    Return a Tensor for keep probability\n    : return: Tensor for keep probability.\n    """\n    # TODO: Implement Function\n    return tf.placeholder(tf.float32, None, name="keep_prob")\n'

Convolution and Max Pooling Layer

Convolution layers have a lot of success with images. For this code cell, you should implement the function conv2d_maxpool to apply convolution then max pooling:

  • Create the weight and bias using conv_ksize, conv_num_outputs and the shape of x_tensor.
  • Apply a convolution to x_tensor using weight and conv_strides.
    • We recommend you use same padding, but you're welcome to use any padding.
  • Add bias
  • Add a nonlinear activation to the convolution.
  • Apply Max Pooling using pool_ksize and pool_strides.
    • We recommend you use same padding, but you're welcome to use any padding.

Note: You can't use TensorFlow Layers or TensorFlow Layers (contrib) for this layer, but you can still use TensorFlow's Neural Network package. You may still use the shortcut option for all the other layers.

In [11]:
def conv2d(x_tensor, conv_num_outputs, conv_ksize, conv_strides, is_training, kernel_regularizer=None):
    """
    Apply convolution then max pooling to x_tensor
    :param x_tensor: TensorFlow Tensor
    :param conv_num_outputs: Number of outputs for the convolutional layer
    :param conv_ksize: kernal size 2-D Tuple for the convolutional layer
    :param conv_strides: Stride 2-D Tuple for convolution
    : return: A tensor that represents convolution of x_tensor
    """
    # TODO: Implement Function
    X_shape = x_tensor.get_shape().as_list()
    C_kshape = list(conv_ksize + (X_shape[-1],) + (conv_num_outputs,))
    
    # The shape of the filter weight is (height, width, input_depth, output_depth)
    # The shape of the filter bias is (output_depth,)
    F_W = tf.Variable(tf.truncated_normal(C_kshape, mean=0.0, stddev=np.sqrt(2.0/np.prod(C_kshape[:3]))),dtype=np.float32)
    #F_W = tf.get_variable('W', shape=C_kshape, initializer=tf.contrib.layers.xavier_initializer(),dtype=np.float32)
    #F_b = tf.Variable(tf.truncated_normal(conv_num_outputs, mean=0.0, stddev=0.15, dtype=np.float32))
    
    if kernel_regularizer=='l2':
        wd = 0.0001
        weight_decay = tf.multiply(tf.nn.l2_loss(F_W), wd, name='weight_loss')
        tf.add_to_collection('losses', weight_decay)
    
    # The shape of the convolution stride is (batch_size, height, width, depth)
    C_strides = list((1,)+conv_strides+(1,))
    
    # The padding, either 'VALID' or 'SAME'.
    padding = 'SAME'
    #conv_output = tf.nn.conv2d(x_tensor, F_W, C_strides, padding) + F_b
    conv_output = tf.nn.conv2d(x_tensor, F_W, C_strides, padding)
    conv_output = tf.layers.batch_normalization(inputs=conv_output, training=is_training)
    conv_output = tf.nn.relu(conv_output)
    
    # Keeping track of weights and biases
    tf.summary.histogram('weights', F_W)
    #tf.summary.histogram('biases', F_b)
    return conv_output


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
#test_con_pool(conv2d_maxpool)
Out[11]:
"\nDON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n"
In [12]:
def pooling(x_tensor, pool_ksize, pool_strides, method='max'):
    """
    Apply convolution then max pooling to x_tensor
    :param x_tensor: TensorFlow Tensor
    :param pool_ksize: kernal size 2-D Tuple for pool
    :param pool_strides: Stride 2-D Tuple for pool
    :param method: max/avg pooling, default is max
    : return: A tensor that represents max pooling of x_tensor
    """
    # TODO: Implement Function
   # The padding, either 'VALID' or 'SAME'.
    padding = 'SAME'
    P_kshape = [1] + list(pool_ksize) + [1]
    P_stride = [1] + list(pool_strides) + [1]
    
    if(method=='max'):
        conv_output = tf.nn.max_pool(x_tensor,P_kshape,P_stride,padding)
    elif(method=='avg'):
        conv_output = tf.nn.avg_pool(x_tensor,P_kshape,P_stride,padding)
    
    return conv_output


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
#test_con_pool(conv2d_maxpool)
Out[12]:
"\nDON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n"

Flatten Layer

Implement the flatten function to change the dimension of x_tensor from a 4-D tensor to a 2-D tensor. The output should be the shape (Batch Size, Flattened Image Size). Shortcut option: you can use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages for this layer. For more of a challenge, only use other TensorFlow packages.

In [13]:
def flatten(x_tensor):
    """
    Flatten x_tensor to (Batch Size, Flattened Image Size)
    : x_tensor: A tensor of size (Batch Size, ...), where ... are the image dimensions.
    : return: A tensor of size (Batch Size, Flattened Image Size).
    """
    # TODO: Implement Function
    # reference : https://github.com/tensorflow/tensorflow/issues/7253
    X_shape = x_tensor.get_shape().as_list()
    return tf.reshape(x_tensor,[-1,np.prod(X_shape[1:])])
    

"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
test_flatten(flatten)
Tests Passed

Fully-Connected Layer

Implement the fully_conn function to apply a fully connected layer to x_tensor with the shape (Batch Size, num_outputs). Shortcut option: you can use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages for this layer. For more of a challenge, only use other TensorFlow packages.

In [14]:
def fully_conn(x_tensor, num_outputs, is_training, kernel_regularizer=None):
    """
    Apply a fully connected layer to x_tensor using weight and bias
    : x_tensor: A 2-D tensor where the first dimension is batch size.
    : num_outputs: The number of output that the new tensor should be.
    : return: A 2-D tensor where the second dimension is num_outputs.
    """
    # TODO: Implement Function
    X_shape = x_tensor.get_shape().as_list()
    shape = list((X_shape[-1],)+(num_outputs,))
    
    W = tf.Variable(tf.truncated_normal(shape, mean=0.0, stddev=np.sqrt(2.0/np.prod(shape[0]))),dtype=np.float32)
    #W = tf.get_variable('W', shape=shape, initializer=tf.contrib.layers.xavier_initializer(),dtype=np.float32)
    #b = tf.Variable(tf.truncated_normal(num_outputs ,mean=0.0, stddev=0.15, dtype=np.float32))
    
    if kernel_regularizer=='l2':
        wd = 0.0001
        weight_decay = tf.multiply(tf.nn.l2_loss(W), wd, name='weight_loss')
        tf.add_to_collection('losses', weight_decay)
    
    #fc_output = tf.tensordot(x_tensor,W,axes=([1], [0]))+b
    fc_output = tf.tensordot(x_tensor,W,axes=([1], [0]))
    fc_output = tf.layers.batch_normalization(inputs=fc_output, training=is_training)
    fc_output = tf.nn.relu(fc_output)
    
    # Keeping track of weights and biases
    tf.summary.histogram('weights', W)
    #tf.summary.histogram('biases', b)
    return fc_output


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
#test_fully_conn(fully_conn)
Out[14]:
"\nDON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n"

Output Layer

Implement the output function to apply a fully connected layer to x_tensor with the shape (Batch Size, num_outputs). Shortcut option: you can use classes from the TensorFlow Layers or TensorFlow Layers (contrib) packages for this layer. For more of a challenge, only use other TensorFlow packages.

Note: Activation, softmax, or cross entropy should not be applied to this.

In [15]:
def output(x_tensor, num_outputs):
    """
    Apply a output layer to x_tensor using weight and bias
    : x_tensor: A 2-D tensor where the first dimension is batch size.
    : num_outputs: The number of output that the new tensor should be.
    : return: A 2-D tensor where the second dimension is num_outputs.
    """
    # TODO: Implement Function
    X_shape = x_tensor.get_shape().as_list()
    shape = list((X_shape[-1],)+(num_outputs,))
    W = tf.Variable(tf.truncated_normal(shape,0.0,0.01),dtype=np.float32)
    b = tf.Variable(tf.zeros(num_outputs,dtype=np.float32))
    return tf.tensordot(x_tensor,W,axes=([1], [0]))+b


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
test_output(output)
Tests Passed
In [16]:
def global_avg_pooling(x_tensor, stride=1):
    X_shape = x_tensor.get_shape().as_list()
    width = X_shape[1]
    height = X_shape[2]
    pool_size = [width, height]
    output = tf.layers.average_pooling2d(inputs=x_tensor, pool_size=pool_size, strides=stride)
    output_shape = output.get_shape().as_list()
    return tf.reshape(output,[-1,np.prod(output_shape[1:])])

Create Convolutional Model

Implement the function conv_net to create a convolutional neural network model. The function takes in a batch of images, x, and outputs logits. Use the layers you created above to create this model:

  • Apply 1, 2, or 3 Convolution and Max Pool layers
  • Apply a Flatten Layer
  • Apply 1, 2, or 3 Fully Connected Layers
  • Apply an Output Layer
  • Return the output
  • Apply TensorFlow's Dropout to one or more layers in the model using keep_prob.
In [17]:
def conv_net(x, keep_prob_1, keep_prob_2, is_training=False):
    """
    Create a convolutional neural network model
    : x: Placeholder tensor that holds image data.
    : keep_prob: Placeholder tensor that hold dropout keep probability.
    : is_training: Placeholder bool that hold the flag to determine training is True or False, default is False
    : return: Tensor that represents logits
    """
    with tf.name_scope("CNN"):
        # TODO: Apply 1, 2, or 3 Convolution and Max Pool layers
        #    Play around with different number of outputs, kernel size and stride
        # Function Definition from Above:
        #    conv2d_maxpool(x_tensor, conv_num_outputs, conv_ksize, conv_strides, pool_ksize, pool_strides)
        conv_num_outputs = [96, 192, 192, 10]
        conv_ksize, conv_strides, pool_ksize, pool_strides = (3, 3), (1, 1), (3, 3), (2, 2)
        with tf.variable_scope("conv1"):
            # 96   conv: 2    max_pool: 1
            conv = conv2d(x, conv_num_outputs[0], conv_ksize, conv_strides, is_training, kernel_regularizer='l2')
            conv = conv2d(conv, conv_num_outputs[0], conv_ksize, conv_strides, is_training)
            conv = conv2d(conv, conv_num_outputs[0], conv_ksize, conv_strides, is_training)
            pool = pooling(conv, pool_ksize, pool_strides, 'max')
            result = tf.nn.dropout(pool, keep_prob_1)
        with tf.variable_scope("conv2"):
            # 192   conv: 3    max_pool: 1   
            conv = conv2d(result, conv_num_outputs[1], conv_ksize, conv_strides, is_training, kernel_regularizer='l2')
            conv = conv2d(conv, conv_num_outputs[1], conv_ksize, conv_strides, is_training)
            conv = conv2d(conv, conv_num_outputs[1], conv_ksize, conv_strides, is_training)
            pool = pooling(conv, pool_ksize, pool_strides, 'max')
            result = tf.nn.dropout(pool, keep_prob_1)
            
        with tf.variable_scope("conv3"):
            # 192   conv: 3    max_pool: 0   
            conv = conv2d(result, conv_num_outputs[2], conv_ksize, conv_strides, is_training, kernel_regularizer='l2')
            conv_ksize, conv_strides = (1, 1), (1, 1)
            conv = conv2d(conv, conv_num_outputs[2], conv_ksize, conv_strides, is_training)
            conv = conv2d(conv, conv_num_outputs[3], conv_ksize, conv_strides, is_training)
            result = tf.nn.dropout(conv, keep_prob_1)
        with tf.variable_scope("global_avg"):
            o = global_avg_pooling(result)
            
        
        # TODO: Apply a Flatten Layer
        # Function Definition from Above:
        #   flatten(x_tensor)
        #flattened = flatten(result)

        # TODO: Apply 1, 2, or 3 Fully Connected Layers
        #    Play around with different number of outputs
        # Function Definition from Above:
        #   fully_conn(x_tensor, num_outputs)
        #num_outputs = [250, 150, 50]
        #with tf.variable_scope("fc1"):
        #    fully = fully_conn(flattened, num_outputs[0], is_training, kernel_regularizer='l2')
        #    fc_layer = tf.nn.dropout(fully, keep_prob_2)
        #with tf.variable_scope("fc2"):
        #    fully = fully_conn(fc_layer, num_outputs[1], is_training)
        #    fc_layer = tf.nn.dropout(fully, keep_prob_2)
        #with tf.variable_scope("fc3"):
        #    fully = fully_conn(fc_layer, num_outputs[2], is_training)
        #    fc_layer = tf.nn.dropout(fully, keep_prob_2)
        
        # TODO: Apply an Output Layer
        #    Set this to the number of classes
        # Function Definition from Above:
        #   output(x_tensor, num_outputs)
        #o = output(fc_layer, 10)

    # TODO: return output
    return o

Building a training op

In [18]:
##############################
## Build the Neural Network ##
##############################

def build_op():
    # Remove previous weights, bias, inputs, etc..
    tf.reset_default_graph()

    # Inputs
    x, y, keep_prob_1, keep_prob_2, lr, is_training = neural_net_input((32,32,3), 10)
    # Model
    logits = conv_net(x, keep_prob_1, keep_prob_2, is_training)
    
    global_step = tf.Variable(0)
    
    # Name logits Tensor, so that is can be loaded from disk after training
    with tf.name_scope('logits'):
        logits = tf.identity(logits, name='logits')

    # Loss and Optimizer
    with tf.name_scope('cost'):
        cross_entropy_mean = tf.reduce_mean(tf.nn.softmax_cross_entropy_with_logits_v2(logits=logits, labels=y), name='cross_entropy_mean')
        tf.add_to_collection('losses', cross_entropy_mean)
        cost = tf.add_n(tf.get_collection('losses'), name='cost')
    
    loss_summ = tf.summary.scalar('loss', cost)
    
    #with tf.name_scope('cost'):
    #    cost = tf.reduce_mean(tf.nn.softmax_cross_entropy_with_logits(logits=logits, labels=y), name='cost')
    #loss_summ = tf.summary.scalar('loss', cost)
    
    with tf.name_scope('train'):
        
        # batch normalization in tensorflow requires this update dependency
        update_ops = tf.get_collection(tf.GraphKeys.UPDATE_OPS)
        with tf.control_dependencies(update_ops):
            optimizer = tf.train.AdamOptimizer(learning_rate=lr).minimize(cost, global_step=global_step)
    
    #tf.add_to_collection('cost_op', cost)
    #tf.add_to_collection('train_op', optimizer)
    
    # Accuracy
    with tf.name_scope('predictions'):
        correct_pred = tf.equal(tf.argmax(logits, 1), tf.argmax(y, 1))
        accuracy = tf.reduce_mean(tf.cast(correct_pred, tf.float32), name='accuracy')
    accuracy_summ = tf.summary.scalar('accuracy', accuracy)
    
    #summary = tf.summary.merge([loss_summ, accuracy_summ], name='summary')
    #Alternatively, you can use tf.summary.merge_all()
    summary = tf.summary.merge_all()
    
    return x, y, keep_prob_1, keep_prob_2, lr, summary, optimizer, cost, accuracy, is_training

#test_conv_net(conv_net)

Train the Neural Network

Single Optimization

Implement the function train_neural_network to do a single optimization. The optimization should use optimizer to optimize in session with a feed_dict of the following:

  • x for image input
  • y for labels
  • keep_prob for keep probability for dropout

This function will be called for each batch, so tf.global_variables_initializer() has already been called.

Note: Nothing needs to be returned. This function is only optimizing the neural network.

In [19]:
def train_neural_network(session, optimizer, keep_probability, feature_batch, label_batch, learn_rate_value):
    """
    Optimize the session on a batch of images and labels
    : session: Current TensorFlow session
    : optimizer: TensorFlow optimizer function
    : keep_probability: keep probability
    : feature_batch: Batch of Numpy image data
    : label_batch: Batch of Numpy label data
    """
    # TODO: Implement Function
    session.run(optimizer, feed_dict={x:feature_batch, y:label_batch, 
                                      keep_prob_1:keep_probability[0], keep_prob_2:keep_probability[1], 
                                      lr:learn_rate_value, is_training:True})


"""
DON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE
"""
#test_train_nn(train_neural_network)
Out[19]:
"\nDON'T MODIFY ANYTHING IN THIS CELL THAT IS BELOW THIS LINE\n"

Show Stats

Implement the function print_stats to print loss and validation accuracy. Use the global variables valid_features and valid_labels to calculate validation accuracy. Use a keep probability of 1.0 to calculate the loss and validation accuracy.

In [20]:
def print_stats(session, feature_batch, label_batch, cost, accuracy, learn_rate_value):
    """
    Print information about loss and validation accuracy
    : session: Current TensorFlow session
    : feature_batch: Batch of Numpy image data
    : label_batch: Batch of Numpy label data
    : cost: TensorFlow cost function
    : accuracy: TensorFlow accuracy function
    """
    # TODO: Implement Function
    loss = session.run(cost, feed_dict={x:feature_batch, y:label_batch, keep_prob_1:1.0, keep_prob_2:1.0,
                                        lr:learn_rate_value, is_training: True})
    valid_acc = sess.run(accuracy, feed_dict={x: valid_features, y: valid_labels, keep_prob_1:1.0, keep_prob_2:1.0,
                                              lr:learn_rate_value, is_training: False})
    print('Loss: {:>10.4f} Validation Accuracy: {:.6f}'.format(loss, valid_acc))
    return loss, valid_acc

Hyperparameters

Tune the following parameters:

  • Set epochs to the number of iterations until the network stops learning or start overfitting
  • Set batch_size to the highest number that your machine has memory for. Most people set them to common sizes of memory:
    • 64
    • 128
    • 256
    • ...
  • Set keep_probability to the probability of keeping a node using dropout
In [21]:
# TODO: Tune Parameters
epochs = 164
batch_size = 128
keep_probability = [0.5, 0.75]
learning_rate_init = 0.001

Train on a Single CIFAR-10 Batch

Instead of training the neural network on all the CIFAR-10 batches of data, let's use a single batch. This should save time while you iterate on the model to get a better accuracy. Once the final validation accuracy is 50% or greater, run the model on all the data in the next section.

In [68]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
print('Checking the Training on a Single Batch...')

x, y, keep_prob_1, keep_prob_2, lr, summary, optimizer, cost, accuracy, is_training = build_op()

with tf.Session() as sess:
    # Initializing the variables
    sess.run(tf.global_variables_initializer())
    # Training cycle
    learning_rate = learning_rate_init
    for epoch in range(epochs):
        batch_i = 1
        if epoch >= 81:
            learning_rate = learning_rate/10
        if epoch >= 122:
            learning_rate = learning_rate/10
        for batch_features, batch_labels in load_preprocess_training_batch(batch_i, batch_size):
            train_neural_network(sess, optimizer, keep_probability, batch_features, batch_labels, learning_rate)
        
        print('Epoch {:>2}, CIFAR-10 Batch {}:  '.format(epoch + 1, batch_i), end='')
        print_stats(sess, batch_features, batch_labels, cost, accuracy, learning_rate)
Checking the Training on a Single Batch...
Epoch  1, CIFAR-10 Batch 1:  Loss:     1.9473 Validation Accuracy: 0.245000
Epoch  2, CIFAR-10 Batch 1:  Loss:     1.8300 Validation Accuracy: 0.322200
Epoch  3, CIFAR-10 Batch 1:  Loss:     1.7565 Validation Accuracy: 0.365400
Epoch  4, CIFAR-10 Batch 1:  Loss:     1.6513 Validation Accuracy: 0.450600
Epoch  5, CIFAR-10 Batch 1:  Loss:     1.5445 Validation Accuracy: 0.505800
Epoch  6, CIFAR-10 Batch 1:  Loss:     1.4710 Validation Accuracy: 0.470400
Epoch  7, CIFAR-10 Batch 1:  Loss:     1.3845 Validation Accuracy: 0.506400
Epoch  8, CIFAR-10 Batch 1:  Loss:     1.3021 Validation Accuracy: 0.527400
Epoch  9, CIFAR-10 Batch 1:  Loss:     1.3158 Validation Accuracy: 0.525400
Epoch 10, CIFAR-10 Batch 1:  Loss:     1.2315 Validation Accuracy: 0.537400
Epoch 11, CIFAR-10 Batch 1:  Loss:     1.1612 Validation Accuracy: 0.572400
Epoch 12, CIFAR-10 Batch 1:  Loss:     1.1000 Validation Accuracy: 0.535000
Epoch 13, CIFAR-10 Batch 1:  Loss:     1.0416 Validation Accuracy: 0.570200
Epoch 14, CIFAR-10 Batch 1:  Loss:     0.9602 Validation Accuracy: 0.608000
Epoch 15, CIFAR-10 Batch 1:  Loss:     0.9714 Validation Accuracy: 0.602800
Epoch 16, CIFAR-10 Batch 1:  Loss:     0.8982 Validation Accuracy: 0.517000
Epoch 17, CIFAR-10 Batch 1:  Loss:     0.8280 Validation Accuracy: 0.575000
Epoch 18, CIFAR-10 Batch 1:  Loss:     0.8111 Validation Accuracy: 0.585200
Epoch 19, CIFAR-10 Batch 1:  Loss:     0.6945 Validation Accuracy: 0.525200
Epoch 20, CIFAR-10 Batch 1:  Loss:     0.6684 Validation Accuracy: 0.578600
Epoch 21, CIFAR-10 Batch 1:  Loss:     0.6277 Validation Accuracy: 0.538400
Epoch 22, CIFAR-10 Batch 1:  Loss:     0.4801 Validation Accuracy: 0.495600
Epoch 23, CIFAR-10 Batch 1:  Loss:     0.4274 Validation Accuracy: 0.462600
Epoch 24, CIFAR-10 Batch 1:  Loss:     0.3744 Validation Accuracy: 0.441400
Epoch 25, CIFAR-10 Batch 1:  Loss:     0.3458 Validation Accuracy: 0.504200
Epoch 26, CIFAR-10 Batch 1:  Loss:     0.2972 Validation Accuracy: 0.580000
Epoch 27, CIFAR-10 Batch 1:  Loss:     0.2757 Validation Accuracy: 0.563200
Epoch 28, CIFAR-10 Batch 1:  Loss:     0.2899 Validation Accuracy: 0.537600
Epoch 29, CIFAR-10 Batch 1:  Loss:     0.2370 Validation Accuracy: 0.568600
Epoch 30, CIFAR-10 Batch 1:  Loss:     0.2387 Validation Accuracy: 0.590600
Epoch 31, CIFAR-10 Batch 1:  Loss:     0.1828 Validation Accuracy: 0.573000
Epoch 32, CIFAR-10 Batch 1:  Loss:     0.1950 Validation Accuracy: 0.579600
Epoch 33, CIFAR-10 Batch 1:  Loss:     0.1770 Validation Accuracy: 0.611400
Epoch 34, CIFAR-10 Batch 1:  Loss:     0.1637 Validation Accuracy: 0.605200
Epoch 35, CIFAR-10 Batch 1:  Loss:     0.1738 Validation Accuracy: 0.629200
Epoch 36, CIFAR-10 Batch 1:  Loss:     0.1693 Validation Accuracy: 0.633400
Epoch 37, CIFAR-10 Batch 1:  Loss:     0.1542 Validation Accuracy: 0.623000
Epoch 38, CIFAR-10 Batch 1:  Loss:     0.1278 Validation Accuracy: 0.627200
Epoch 39, CIFAR-10 Batch 1:  Loss:     0.1338 Validation Accuracy: 0.663600
Epoch 40, CIFAR-10 Batch 1:  Loss:     0.1442 Validation Accuracy: 0.629600
Epoch 41, CIFAR-10 Batch 1:  Loss:     0.1399 Validation Accuracy: 0.531600
Epoch 42, CIFAR-10 Batch 1:  Loss:     0.1365 Validation Accuracy: 0.636600
Epoch 43, CIFAR-10 Batch 1:  Loss:     0.1174 Validation Accuracy: 0.601000
Epoch 44, CIFAR-10 Batch 1:  Loss:     0.1176 Validation Accuracy: 0.598400
Epoch 45, CIFAR-10 Batch 1:  Loss:     0.1337 Validation Accuracy: 0.635600
Epoch 46, CIFAR-10 Batch 1:  Loss:     0.1209 Validation Accuracy: 0.651200
Epoch 47, CIFAR-10 Batch 1:  Loss:     0.1171 Validation Accuracy: 0.595600
Epoch 48, CIFAR-10 Batch 1:  Loss:     0.1334 Validation Accuracy: 0.582600
Epoch 49, CIFAR-10 Batch 1:  Loss:     0.1040 Validation Accuracy: 0.645400
Epoch 50, CIFAR-10 Batch 1:  Loss:     0.1083 Validation Accuracy: 0.638400
Epoch 51, CIFAR-10 Batch 1:  Loss:     0.1134 Validation Accuracy: 0.610400
Epoch 52, CIFAR-10 Batch 1:  Loss:     0.1063 Validation Accuracy: 0.633400
Epoch 53, CIFAR-10 Batch 1:  Loss:     0.1231 Validation Accuracy: 0.641800
Epoch 54, CIFAR-10 Batch 1:  Loss:     0.1090 Validation Accuracy: 0.637600
Epoch 55, CIFAR-10 Batch 1:  Loss:     0.1052 Validation Accuracy: 0.633200
Epoch 56, CIFAR-10 Batch 1:  Loss:     0.1076 Validation Accuracy: 0.616000
Epoch 57, CIFAR-10 Batch 1:  Loss:     0.0998 Validation Accuracy: 0.640000
Epoch 58, CIFAR-10 Batch 1:  Loss:     0.1085 Validation Accuracy: 0.593400
Epoch 59, CIFAR-10 Batch 1:  Loss:     0.1015 Validation Accuracy: 0.638800
Epoch 60, CIFAR-10 Batch 1:  Loss:     0.1088 Validation Accuracy: 0.591600
Epoch 61, CIFAR-10 Batch 1:  Loss:     0.1022 Validation Accuracy: 0.615000
Epoch 62, CIFAR-10 Batch 1:  Loss:     0.0991 Validation Accuracy: 0.620600
Epoch 63, CIFAR-10 Batch 1:  Loss:     0.1034 Validation Accuracy: 0.658200
Epoch 64, CIFAR-10 Batch 1:  Loss:     0.0995 Validation Accuracy: 0.615400
Epoch 65, CIFAR-10 Batch 1:  Loss:     0.0991 Validation Accuracy: 0.654000
Epoch 66, CIFAR-10 Batch 1:  Loss:     0.1123 Validation Accuracy: 0.653400
Epoch 67, CIFAR-10 Batch 1:  Loss:     0.1027 Validation Accuracy: 0.633200
Epoch 68, CIFAR-10 Batch 1:  Loss:     0.1232 Validation Accuracy: 0.658600
Epoch 69, CIFAR-10 Batch 1:  Loss:     0.0990 Validation Accuracy: 0.659400
Epoch 70, CIFAR-10 Batch 1:  Loss:     0.0992 Validation Accuracy: 0.662600
Epoch 71, CIFAR-10 Batch 1:  Loss:     0.1059 Validation Accuracy: 0.647800
Epoch 72, CIFAR-10 Batch 1:  Loss:     0.0996 Validation Accuracy: 0.658400
Epoch 73, CIFAR-10 Batch 1:  Loss:     0.1017 Validation Accuracy: 0.660400
Epoch 74, CIFAR-10 Batch 1:  Loss:     0.1001 Validation Accuracy: 0.660800
Epoch 75, CIFAR-10 Batch 1:  Loss:     0.0991 Validation Accuracy: 0.656600
Epoch 76, CIFAR-10 Batch 1:  Loss:     0.1005 Validation Accuracy: 0.607000
Epoch 77, CIFAR-10 Batch 1:  Loss:     0.0995 Validation Accuracy: 0.623800
Epoch 78, CIFAR-10 Batch 1:  Loss:     0.0977 Validation Accuracy: 0.630200
Epoch 79, CIFAR-10 Batch 1:  Loss:     0.0996 Validation Accuracy: 0.681600
Epoch 80, CIFAR-10 Batch 1:  Loss:     0.0967 Validation Accuracy: 0.671000
Epoch 81, CIFAR-10 Batch 1:  Loss:     0.1000 Validation Accuracy: 0.675400
Epoch 82, CIFAR-10 Batch 1:  Loss:     0.0945 Validation Accuracy: 0.706600
Epoch 83, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713200
Epoch 84, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 85, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714600
Epoch 86, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713800
Epoch 87, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714400
Epoch 88, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713600
Epoch 89, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713800
Epoch 90, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713600
Epoch 91, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 92, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 93, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714400
Epoch 94, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 95, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714800
Epoch 96, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 97, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.715200
Epoch 98, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714800
Epoch 99, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 100, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 101, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713800
Epoch 102, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 103, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714800
Epoch 104, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 105, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 106, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 107, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.715000
Epoch 108, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 109, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713600
Epoch 110, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.715000
Epoch 111, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 112, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713800
Epoch 113, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 114, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714800
Epoch 115, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 116, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.715000
Epoch 117, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714400
Epoch 118, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 119, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 120, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713600
Epoch 121, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 122, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713800
Epoch 123, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714800
Epoch 124, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 125, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713800
Epoch 126, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713400
Epoch 127, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713600
Epoch 128, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714800
Epoch 129, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.715000
Epoch 130, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713600
Epoch 131, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.715800
Epoch 132, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 133, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 134, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714600
Epoch 135, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714800
Epoch 136, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 137, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714800
Epoch 138, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714400
Epoch 139, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 140, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713800
Epoch 141, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714800
Epoch 142, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714600
Epoch 143, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.715400
Epoch 144, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 145, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 146, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 147, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 148, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 149, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.715200
Epoch 150, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714400
Epoch 151, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.715000
Epoch 152, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714600
Epoch 153, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714600
Epoch 154, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 155, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714400
Epoch 156, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.715000
Epoch 157, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714800
Epoch 158, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.715400
Epoch 159, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713800
Epoch 160, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200
Epoch 161, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714400
Epoch 162, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714000
Epoch 163, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.713200
Epoch 164, CIFAR-10 Batch 1:  Loss:     0.0944 Validation Accuracy: 0.714200

Fully Train the Model

Now that you got a good accuracy with a single CIFAR-10 batch, try it with all five batches.

In [ ]:
"""
DON'T MODIFY ANYTHING IN THIS CELL
"""
save_model_path = './image_classification'

loss = []
acc =  []
x, y, keep_prob_1, keep_prob_2, lr, summary, optimizer, cost, accuracy, is_training = build_op()

print('Training...')
with tf.Session() as sess:
    # Initializing the variables
    sess.run(tf.global_variables_initializer())
    learning_rate = learning_rate_init
    # Training cycle
    for epoch in range(epochs):
        # Loop over all batches
        n_batches = 50
        if epoch >= 81:
            learning_rate = learning_rate/10
        if epoch >= 122:
            learning_rate = learning_rate/10
        for batch_i in range(1, n_batches + 1):
            for batch_features, batch_labels in load_preprocess_training_batch(batch_i, batch_size):
                train_neural_network(sess, optimizer, keep_probability, batch_features, batch_labels, learning_rate)
            print('Epoch {:>2}, CIFAR-10 Batch {}:  '.format(epoch + 1, batch_i), end='')
            train_loss,val_acc=print_stats(sess, batch_features, batch_labels, cost, accuracy, learning_rate)
            loss.append(train_loss)
            acc.append(val_acc)
            
    # Save Model
    saver = tf.train.Saver()
    save_path = saver.save(sess, save_model_path)
In [ ]:
import matplotlib.pyplot as plt
%matplotlib inline
plt.plot(loss, label='Validation loss', color='darkorange')
plt.legend()
_ = plt.ylim()
In [ ]:
import matplotlib.pyplot as plt
%matplotlib inline
plt.plot(acc, label='Validation accuracy', color='green')
plt.legend()
_ = plt.ylim()
In [22]:
#for batch_size in [512, 128, 32, 8, 2]:
#for learning_rate in [0.01, 0.001, 0.0001]:

x, y, keep_prob_1, keep_prob_2, lr, summary, optimizer, cost, accuracy, is_training = build_op()

with tf.Session() as sess:
    steps = 0
    counter = 0
    learning_rate = learning_rate_init
    # Initializing the variables
    sess.run(tf.global_variables_initializer())

    # If you want to compare training and validation, one good way to do it is to use two separate
    # file writer to keep logs for each process but keep them in the same folder. This way, you can 
    # later view them in the same plot. 
    #train_log_string = 'log/train, learning_rate={:.5f}, batch_size={}'.format(learning_rate, batch_size)
    valid_log_string = './tmp/log/valid, learning_rate={:.5f}, batch_size={}'.format(learning_rate, batch_size)
    #train_filewriter = tf.summary.FileWriter(train_log_string, sess.graph)
    valid_filewriter = tf.summary.FileWriter(valid_log_string, sess.graph)
    
    # Training cycle
    for epoch in range(epochs):
        # Loop over all batches
        n_batches = 50
        if epoch >= 81:
            learning_rate = learning_rate/10
        if epoch >= 122:
            learning_rate = learning_rate/10
        for batch_i in range(1, n_batches + 1):
            for batch_features, batch_labels in load_preprocess_training_batch(batch_i, batch_size):
                steps += batch_features.shape[0]
                counter += batch_features.shape[0]
                sess.run(optimizer, feed_dict={x: batch_features, y: batch_labels,
                                               keep_prob_1:keep_probability[0], keep_prob_2:keep_probability[1],
                                               lr:learning_rate, is_training:True})

                # Log only after the model is trained on every 500 samples. Getting summary takes time, so the 
                # more frequently you look, the more extra time it'll cost you.
                if counter > 1000:
                    #train_summ = sess.run(summary, feed_dict={x: batch_features, y: batch_labels,
                    #                                                   keep_prob: 1., lr:learning_rate})
                    #train_filewriter.add_summary(train_summ, steps)
                    valid_summ = sess.run(summary, feed_dict={x: valid_features, y: valid_labels,
                                                               keep_prob_1:1.0, keep_prob_2:1.0,
                                                              lr:learning_rate, is_training:False})

                    valid_filewriter.add_summary(valid_summ, steps)
                    counter -= 1000

            loss = sess.run(cost, feed_dict={x:batch_features, y:batch_labels, keep_prob_1:1.0, keep_prob_2:1.0,
                                             lr:learning_rate, is_training:True})
            
            valid_acc = sess.run(accuracy, feed_dict={x: valid_features, y: valid_labels, keep_prob_1:1.0, keep_prob_2:1.0,
                                                      lr:learning_rate, is_training:False})
        
            print('Epoch {:>2}, CIFAR-10 Batch {}:  '.format(epoch + 1, batch_i), end='')
            print('Loss: {:>10.4f} Validation Accuracy: {:.6f}'.format(loss, valid_acc))
    # Save Model
    save_model_path = './image_classification'
    saver = tf.train.Saver()
    save_path = saver.save(sess, save_model_path)
Epoch  1, CIFAR-10 Batch 1:  Loss:     1.9208 Validation Accuracy: 0.174200
Epoch  1, CIFAR-10 Batch 2:  Loss:     1.6730 Validation Accuracy: 0.209200
Epoch  1, CIFAR-10 Batch 3:  Loss:     1.6251 Validation Accuracy: 0.233200
Epoch  1, CIFAR-10 Batch 4:  Loss:     1.7033 Validation Accuracy: 0.343000
Epoch  1, CIFAR-10 Batch 5:  Loss:     1.4564 Validation Accuracy: 0.496800
Epoch  1, CIFAR-10 Batch 6:  Loss:     1.6997 Validation Accuracy: 0.377200
Epoch  1, CIFAR-10 Batch 7:  Loss:     1.6182 Validation Accuracy: 0.497200
Epoch  1, CIFAR-10 Batch 8:  Loss:     1.4463 Validation Accuracy: 0.513800
Epoch  1, CIFAR-10 Batch 9:  Loss:     1.7632 Validation Accuracy: 0.533800
Epoch  1, CIFAR-10 Batch 10:  Loss:     1.2241 Validation Accuracy: 0.496000
Epoch  1, CIFAR-10 Batch 11:  Loss:     1.4642 Validation Accuracy: 0.530200
Epoch  1, CIFAR-10 Batch 12:  Loss:     1.4035 Validation Accuracy: 0.541600
Epoch  1, CIFAR-10 Batch 13:  Loss:     1.2370 Validation Accuracy: 0.562400
Epoch  1, CIFAR-10 Batch 14:  Loss:     1.2854 Validation Accuracy: 0.590000
Epoch  1, CIFAR-10 Batch 15:  Loss:     1.3215 Validation Accuracy: 0.567800
Epoch  1, CIFAR-10 Batch 16:  Loss:     1.2504 Validation Accuracy: 0.582800
Epoch  1, CIFAR-10 Batch 17:  Loss:     1.4759 Validation Accuracy: 0.632400
Epoch  1, CIFAR-10 Batch 18:  Loss:     1.1935 Validation Accuracy: 0.600000
Epoch  1, CIFAR-10 Batch 19:  Loss:     1.1605 Validation Accuracy: 0.576000
Epoch  1, CIFAR-10 Batch 20:  Loss:     1.2916 Validation Accuracy: 0.588000
Epoch  1, CIFAR-10 Batch 21:  Loss:     1.1423 Validation Accuracy: 0.642400
Epoch  1, CIFAR-10 Batch 22:  Loss:     1.1655 Validation Accuracy: 0.639800
Epoch  1, CIFAR-10 Batch 23:  Loss:     1.1246 Validation Accuracy: 0.613800
Epoch  1, CIFAR-10 Batch 24:  Loss:     1.0855 Validation Accuracy: 0.674200
Epoch  1, CIFAR-10 Batch 25:  Loss:     0.9019 Validation Accuracy: 0.638200
Epoch  1, CIFAR-10 Batch 26:  Loss:     0.9625 Validation Accuracy: 0.668800
Epoch  1, CIFAR-10 Batch 27:  Loss:     0.8419 Validation Accuracy: 0.586000
Epoch  1, CIFAR-10 Batch 28:  Loss:     1.0346 Validation Accuracy: 0.672200
Epoch  1, CIFAR-10 Batch 29:  Loss:     1.0232 Validation Accuracy: 0.679000
Epoch  1, CIFAR-10 Batch 30:  Loss:     0.9698 Validation Accuracy: 0.687800
Epoch  1, CIFAR-10 Batch 31:  Loss:     0.9707 Validation Accuracy: 0.710600
Epoch  1, CIFAR-10 Batch 32:  Loss:     0.9137 Validation Accuracy: 0.621200
Epoch  1, CIFAR-10 Batch 33:  Loss:     1.0874 Validation Accuracy: 0.703400
Epoch  1, CIFAR-10 Batch 34:  Loss:     1.2363 Validation Accuracy: 0.706400
Epoch  1, CIFAR-10 Batch 35:  Loss:     0.8887 Validation Accuracy: 0.684400
Epoch  1, CIFAR-10 Batch 36:  Loss:     0.9751 Validation Accuracy: 0.714800
Epoch  1, CIFAR-10 Batch 37:  Loss:     0.9450 Validation Accuracy: 0.705600
Epoch  1, CIFAR-10 Batch 38:  Loss:     0.9124 Validation Accuracy: 0.618400
Epoch  1, CIFAR-10 Batch 39:  Loss:     0.9223 Validation Accuracy: 0.714200
Epoch  1, CIFAR-10 Batch 40:  Loss:     1.0030 Validation Accuracy: 0.668000
Epoch  1, CIFAR-10 Batch 41:  Loss:     0.7837 Validation Accuracy: 0.734600
Epoch  1, CIFAR-10 Batch 42:  Loss:     0.9506 Validation Accuracy: 0.669400
Epoch  1, CIFAR-10 Batch 43:  Loss:     1.1570 Validation Accuracy: 0.746000
Epoch  1, CIFAR-10 Batch 44:  Loss:     0.9120 Validation Accuracy: 0.748200
Epoch  1, CIFAR-10 Batch 45:  Loss:     0.9285 Validation Accuracy: 0.728000
Epoch  1, CIFAR-10 Batch 46:  Loss:     1.0531 Validation Accuracy: 0.733400
Epoch  1, CIFAR-10 Batch 47:  Loss:     0.9210 Validation Accuracy: 0.745800
Epoch  1, CIFAR-10 Batch 48:  Loss:     0.9449 Validation Accuracy: 0.718400
Epoch  1, CIFAR-10 Batch 49:  Loss:     1.0961 Validation Accuracy: 0.718200
Epoch  1, CIFAR-10 Batch 50:  Loss:     0.8137 Validation Accuracy: 0.730600
Epoch  2, CIFAR-10 Batch 1:  Loss:     1.0757 Validation Accuracy: 0.747800
Epoch  2, CIFAR-10 Batch 2:  Loss:     0.7843 Validation Accuracy: 0.742200
Epoch  2, CIFAR-10 Batch 3:  Loss:     0.5884 Validation Accuracy: 0.763200
Epoch  2, CIFAR-10 Batch 4:  Loss:     0.7745 Validation Accuracy: 0.773400
Epoch  2, CIFAR-10 Batch 5:  Loss:     0.7567 Validation Accuracy: 0.754000
Epoch  2, CIFAR-10 Batch 6:  Loss:     0.8854 Validation Accuracy: 0.728400
Epoch  2, CIFAR-10 Batch 7:  Loss:     0.7489 Validation Accuracy: 0.745200
Epoch  2, CIFAR-10 Batch 8:  Loss:     0.8628 Validation Accuracy: 0.715600
Epoch  2, CIFAR-10 Batch 9:  Loss:     0.9758 Validation Accuracy: 0.754400
Epoch  2, CIFAR-10 Batch 10:  Loss:     0.5687 Validation Accuracy: 0.744400
Epoch  2, CIFAR-10 Batch 11:  Loss:     0.8344 Validation Accuracy: 0.685400
Epoch  2, CIFAR-10 Batch 12:  Loss:     0.8491 Validation Accuracy: 0.699800
Epoch  2, CIFAR-10 Batch 13:  Loss:     0.6863 Validation Accuracy: 0.712400
Epoch  2, CIFAR-10 Batch 14:  Loss:     0.7866 Validation Accuracy: 0.696200
Epoch  2, CIFAR-10 Batch 15:  Loss:     0.8216 Validation Accuracy: 0.738600
Epoch  2, CIFAR-10 Batch 16:  Loss:     0.7869 Validation Accuracy: 0.713000
Epoch  2, CIFAR-10 Batch 17:  Loss:     1.0868 Validation Accuracy: 0.726400
Epoch  2, CIFAR-10 Batch 18:  Loss:     0.7462 Validation Accuracy: 0.754600
Epoch  2, CIFAR-10 Batch 19:  Loss:     0.5720 Validation Accuracy: 0.782200
Epoch  2, CIFAR-10 Batch 20:  Loss:     1.0012 Validation Accuracy: 0.669600
Epoch  2, CIFAR-10 Batch 21:  Loss:     0.7812 Validation Accuracy: 0.761400
Epoch  2, CIFAR-10 Batch 22:  Loss:     0.7020 Validation Accuracy: 0.761000
Epoch  2, CIFAR-10 Batch 23:  Loss:     0.7683 Validation Accuracy: 0.762200
Epoch  2, CIFAR-10 Batch 24:  Loss:     0.7788 Validation Accuracy: 0.766000
Epoch  2, CIFAR-10 Batch 25:  Loss:     0.6861 Validation Accuracy: 0.717200
Epoch  2, CIFAR-10 Batch 26:  Loss:     0.6700 Validation Accuracy: 0.773000
Epoch  2, CIFAR-10 Batch 27:  Loss:     0.5275 Validation Accuracy: 0.747200
Epoch  2, CIFAR-10 Batch 28:  Loss:     0.7901 Validation Accuracy: 0.791400
Epoch  2, CIFAR-10 Batch 29:  Loss:     0.6763 Validation Accuracy: 0.797800
Epoch  2, CIFAR-10 Batch 30:  Loss:     0.5639 Validation Accuracy: 0.742800
Epoch  2, CIFAR-10 Batch 31:  Loss:     0.6402 Validation Accuracy: 0.763400
Epoch  2, CIFAR-10 Batch 32:  Loss:     0.6679 Validation Accuracy: 0.716200
Epoch  2, CIFAR-10 Batch 33:  Loss:     0.8889 Validation Accuracy: 0.761000
Epoch  2, CIFAR-10 Batch 34:  Loss:     0.9139 Validation Accuracy: 0.757800
Epoch  2, CIFAR-10 Batch 35:  Loss:     0.6554 Validation Accuracy: 0.794800
Epoch  2, CIFAR-10 Batch 36:  Loss:     0.6063 Validation Accuracy: 0.782000
Epoch  2, CIFAR-10 Batch 37:  Loss:     0.6947 Validation Accuracy: 0.783200
Epoch  2, CIFAR-10 Batch 38:  Loss:     0.6220 Validation Accuracy: 0.760000
Epoch  2, CIFAR-10 Batch 39:  Loss:     0.5616 Validation Accuracy: 0.797000
Epoch  2, CIFAR-10 Batch 40:  Loss:     0.6915 Validation Accuracy: 0.770000
Epoch  2, CIFAR-10 Batch 41:  Loss:     0.6883 Validation Accuracy: 0.771000
Epoch  2, CIFAR-10 Batch 42:  Loss:     0.7191 Validation Accuracy: 0.780600
Epoch  2, CIFAR-10 Batch 43:  Loss:     0.8712 Validation Accuracy: 0.788000
Epoch  2, CIFAR-10 Batch 44:  Loss:     0.7848 Validation Accuracy: 0.769200
Epoch  2, CIFAR-10 Batch 45:  Loss:     0.7162 Validation Accuracy: 0.792600
Epoch  2, CIFAR-10 Batch 46:  Loss:     0.7813 Validation Accuracy: 0.781000
Epoch  2, CIFAR-10 Batch 47:  Loss:     0.7729 Validation Accuracy: 0.798800
Epoch  2, CIFAR-10 Batch 48:  Loss:     0.8163 Validation Accuracy: 0.796200
Epoch  2, CIFAR-10 Batch 49:  Loss:     0.8486 Validation Accuracy: 0.789400
Epoch  2, CIFAR-10 Batch 50:  Loss:     0.6461 Validation Accuracy: 0.774200
Epoch  3, CIFAR-10 Batch 1:  Loss:     0.8442 Validation Accuracy: 0.794400
Epoch  3, CIFAR-10 Batch 2:  Loss:     0.5837 Validation Accuracy: 0.790800
Epoch  3, CIFAR-10 Batch 3:  Loss:     0.4160 Validation Accuracy: 0.808800
Epoch  3, CIFAR-10 Batch 4:  Loss:     0.5626 Validation Accuracy: 0.807400
Epoch  3, CIFAR-10 Batch 5:  Loss:     0.5924 Validation Accuracy: 0.783200
Epoch  3, CIFAR-10 Batch 6:  Loss:     0.7246 Validation Accuracy: 0.809400
Epoch  3, CIFAR-10 Batch 7:  Loss:     0.6370 Validation Accuracy: 0.748400
Epoch  3, CIFAR-10 Batch 8:  Loss:     0.7720 Validation Accuracy: 0.798200
Epoch  3, CIFAR-10 Batch 9:  Loss:     0.7056 Validation Accuracy: 0.786200
Epoch  3, CIFAR-10 Batch 10:  Loss:     0.3422 Validation Accuracy: 0.812600
Epoch  3, CIFAR-10 Batch 11:  Loss:     0.8171 Validation Accuracy: 0.780600
Epoch  3, CIFAR-10 Batch 12:  Loss:     0.6999 Validation Accuracy: 0.804200
Epoch  3, CIFAR-10 Batch 13:  Loss:     0.6454 Validation Accuracy: 0.792400
Epoch  3, CIFAR-10 Batch 14:  Loss:     0.6584 Validation Accuracy: 0.806400
Epoch  3, CIFAR-10 Batch 15:  Loss:     0.7725 Validation Accuracy: 0.785000
Epoch  3, CIFAR-10 Batch 16:  Loss:     0.6285 Validation Accuracy: 0.774000
Epoch  3, CIFAR-10 Batch 17:  Loss:     0.9312 Validation Accuracy: 0.818200
Epoch  3, CIFAR-10 Batch 18:  Loss:     0.5154 Validation Accuracy: 0.810000
Epoch  3, CIFAR-10 Batch 19:  Loss:     0.4664 Validation Accuracy: 0.806400
Epoch  3, CIFAR-10 Batch 20:  Loss:     0.8741 Validation Accuracy: 0.800800
Epoch  3, CIFAR-10 Batch 21:  Loss:     0.6356 Validation Accuracy: 0.778800
Epoch  3, CIFAR-10 Batch 22:  Loss:     0.6921 Validation Accuracy: 0.799000
Epoch  3, CIFAR-10 Batch 23:  Loss:     0.6691 Validation Accuracy: 0.810400
Epoch  3, CIFAR-10 Batch 24:  Loss:     0.6628 Validation Accuracy: 0.785400
Epoch  3, CIFAR-10 Batch 25:  Loss:     0.6018 Validation Accuracy: 0.775400
Epoch  3, CIFAR-10 Batch 26:  Loss:     0.4532 Validation Accuracy: 0.809200
Epoch  3, CIFAR-10 Batch 27:  Loss:     0.4650 Validation Accuracy: 0.776400
Epoch  3, CIFAR-10 Batch 28:  Loss:     0.7295 Validation Accuracy: 0.799400
Epoch  3, CIFAR-10 Batch 29:  Loss:     0.5872 Validation Accuracy: 0.815200
Epoch  3, CIFAR-10 Batch 30:  Loss:     0.3991 Validation Accuracy: 0.796600
Epoch  3, CIFAR-10 Batch 31:  Loss:     0.5118 Validation Accuracy: 0.762200
Epoch  3, CIFAR-10 Batch 32:  Loss:     0.4789 Validation Accuracy: 0.787400
Epoch  3, CIFAR-10 Batch 33:  Loss:     0.8369 Validation Accuracy: 0.813400
Epoch  3, CIFAR-10 Batch 34:  Loss:     0.7313 Validation Accuracy: 0.767400
Epoch  3, CIFAR-10 Batch 35:  Loss:     0.6416 Validation Accuracy: 0.764400
Epoch  3, CIFAR-10 Batch 36:  Loss:     0.5685 Validation Accuracy: 0.791600
Epoch  3, CIFAR-10 Batch 37:  Loss:     0.6867 Validation Accuracy: 0.816600
Epoch  3, CIFAR-10 Batch 38:  Loss:     0.4069 Validation Accuracy: 0.748000
Epoch  3, CIFAR-10 Batch 39:  Loss:     0.5245 Validation Accuracy: 0.813600
Epoch  3, CIFAR-10 Batch 40:  Loss:     0.6984 Validation Accuracy: 0.802800
Epoch  3, CIFAR-10 Batch 41:  Loss:     0.5141 Validation Accuracy: 0.776200
Epoch  3, CIFAR-10 Batch 42:  Loss:     0.6209 Validation Accuracy: 0.813600
Epoch  3, CIFAR-10 Batch 43:  Loss:     0.7383 Validation Accuracy: 0.817000
Epoch  3, CIFAR-10 Batch 44:  Loss:     0.6289 Validation Accuracy: 0.816200
Epoch  3, CIFAR-10 Batch 45:  Loss:     0.6376 Validation Accuracy: 0.804600
Epoch  3, CIFAR-10 Batch 46:  Loss:     0.6998 Validation Accuracy: 0.764800
Epoch  3, CIFAR-10 Batch 47:  Loss:     0.5983 Validation Accuracy: 0.807200
Epoch  3, CIFAR-10 Batch 48:  Loss:     0.6714 Validation Accuracy: 0.827800
Epoch  3, CIFAR-10 Batch 49:  Loss:     0.7672 Validation Accuracy: 0.815200
Epoch  3, CIFAR-10 Batch 50:  Loss:     0.5694 Validation Accuracy: 0.800400
Epoch  4, CIFAR-10 Batch 1:  Loss:     0.6853 Validation Accuracy: 0.827000
Epoch  4, CIFAR-10 Batch 2:  Loss:     0.4810 Validation Accuracy: 0.808400
Epoch  4, CIFAR-10 Batch 3:  Loss:     0.3725 Validation Accuracy: 0.822000
Epoch  4, CIFAR-10 Batch 4:  Loss:     0.5212 Validation Accuracy: 0.819400
Epoch  4, CIFAR-10 Batch 5:  Loss:     0.5654 Validation Accuracy: 0.825400
Epoch  4, CIFAR-10 Batch 6:  Loss:     0.7069 Validation Accuracy: 0.816400
Epoch  4, CIFAR-10 Batch 7:  Loss:     0.4745 Validation Accuracy: 0.805800
Epoch  4, CIFAR-10 Batch 8:  Loss:     0.7173 Validation Accuracy: 0.817000
Epoch  4, CIFAR-10 Batch 9:  Loss:     0.7296 Validation Accuracy: 0.805000
Epoch  4, CIFAR-10 Batch 10:  Loss:     0.3683 Validation Accuracy: 0.779200
Epoch  4, CIFAR-10 Batch 11:  Loss:     0.6551 Validation Accuracy: 0.809800
Epoch  4, CIFAR-10 Batch 12:  Loss:     0.7227 Validation Accuracy: 0.812600
Epoch  4, CIFAR-10 Batch 13:  Loss:     0.5827 Validation Accuracy: 0.808600
Epoch  4, CIFAR-10 Batch 14:  Loss:     0.5451 Validation Accuracy: 0.825600
Epoch  4, CIFAR-10 Batch 15:  Loss:     0.6490 Validation Accuracy: 0.804400
Epoch  4, CIFAR-10 Batch 16:  Loss:     0.6102 Validation Accuracy: 0.777600
Epoch  4, CIFAR-10 Batch 17:  Loss:     0.7713 Validation Accuracy: 0.834400
Epoch  4, CIFAR-10 Batch 18:  Loss:     0.4922 Validation Accuracy: 0.818400
Epoch  4, CIFAR-10 Batch 19:  Loss:     0.4511 Validation Accuracy: 0.825800
Epoch  4, CIFAR-10 Batch 20:  Loss:     0.7661 Validation Accuracy: 0.801200
Epoch  4, CIFAR-10 Batch 21:  Loss:     0.6328 Validation Accuracy: 0.809800
Epoch  4, CIFAR-10 Batch 22:  Loss:     0.5438 Validation Accuracy: 0.812800
Epoch  4, CIFAR-10 Batch 23:  Loss:     0.5941 Validation Accuracy: 0.814600
Epoch  4, CIFAR-10 Batch 24:  Loss:     0.6280 Validation Accuracy: 0.821200
Epoch  4, CIFAR-10 Batch 25:  Loss:     0.4964 Validation Accuracy: 0.796600
Epoch  4, CIFAR-10 Batch 26:  Loss:     0.4671 Validation Accuracy: 0.823800
Epoch  4, CIFAR-10 Batch 27:  Loss:     0.3878 Validation Accuracy: 0.791800
Epoch  4, CIFAR-10 Batch 28:  Loss:     0.5327 Validation Accuracy: 0.817400
Epoch  4, CIFAR-10 Batch 29:  Loss:     0.5626 Validation Accuracy: 0.793400
Epoch  4, CIFAR-10 Batch 30:  Loss:     0.3325 Validation Accuracy: 0.804800
Epoch  4, CIFAR-10 Batch 31:  Loss:     0.5490 Validation Accuracy: 0.808200
Epoch  4, CIFAR-10 Batch 32:  Loss:     0.3705 Validation Accuracy: 0.805600
Epoch  4, CIFAR-10 Batch 33:  Loss:     0.6588 Validation Accuracy: 0.811400
Epoch  4, CIFAR-10 Batch 34:  Loss:     0.7322 Validation Accuracy: 0.842800
Epoch  4, CIFAR-10 Batch 35:  Loss:     0.5869 Validation Accuracy: 0.834600
Epoch  4, CIFAR-10 Batch 36:  Loss:     0.5284 Validation Accuracy: 0.812400
Epoch  4, CIFAR-10 Batch 37:  Loss:     0.5296 Validation Accuracy: 0.827600
Epoch  4, CIFAR-10 Batch 38:  Loss:     0.3551 Validation Accuracy: 0.811400
Epoch  4, CIFAR-10 Batch 39:  Loss:     0.3925 Validation Accuracy: 0.795200
Epoch  4, CIFAR-10 Batch 40:  Loss:     0.5786 Validation Accuracy: 0.765800
Epoch  4, CIFAR-10 Batch 41:  Loss:     0.5189 Validation Accuracy: 0.809200
Epoch  4, CIFAR-10 Batch 42:  Loss:     0.5741 Validation Accuracy: 0.805000
Epoch  4, CIFAR-10 Batch 43:  Loss:     0.6254 Validation Accuracy: 0.831000
Epoch  4, CIFAR-10 Batch 44:  Loss:     0.4686 Validation Accuracy: 0.821800
Epoch  4, CIFAR-10 Batch 45:  Loss:     0.5203 Validation Accuracy: 0.843000
Epoch  4, CIFAR-10 Batch 46:  Loss:     0.6487 Validation Accuracy: 0.838000
Epoch  4, CIFAR-10 Batch 47:  Loss:     0.5230 Validation Accuracy: 0.831400
Epoch  4, CIFAR-10 Batch 48:  Loss:     0.5957 Validation Accuracy: 0.823600
Epoch  4, CIFAR-10 Batch 49:  Loss:     0.7847 Validation Accuracy: 0.823800
Epoch  4, CIFAR-10 Batch 50:  Loss:     0.5029 Validation Accuracy: 0.831400
Epoch  5, CIFAR-10 Batch 1:  Loss:     0.5626 Validation Accuracy: 0.822000
Epoch  5, CIFAR-10 Batch 2:  Loss:     0.4240 Validation Accuracy: 0.835200
Epoch  5, CIFAR-10 Batch 3:  Loss:     0.3282 Validation Accuracy: 0.839400
Epoch  5, CIFAR-10 Batch 4:  Loss:     0.4086 Validation Accuracy: 0.830000
Epoch  5, CIFAR-10 Batch 5:  Loss:     0.4819 Validation Accuracy: 0.800800
Epoch  5, CIFAR-10 Batch 6:  Loss:     0.6588 Validation Accuracy: 0.830600
Epoch  5, CIFAR-10 Batch 7:  Loss:     0.3757 Validation Accuracy: 0.812400
Epoch  5, CIFAR-10 Batch 8:  Loss:     0.6095 Validation Accuracy: 0.834000
Epoch  5, CIFAR-10 Batch 9:  Loss:     0.6568 Validation Accuracy: 0.823000
Epoch  5, CIFAR-10 Batch 10:  Loss:     0.3140 Validation Accuracy: 0.783800
Epoch  5, CIFAR-10 Batch 11:  Loss:     0.5393 Validation Accuracy: 0.826400
Epoch  5, CIFAR-10 Batch 12:  Loss:     0.6909 Validation Accuracy: 0.816400
Epoch  5, CIFAR-10 Batch 13:  Loss:     0.5368 Validation Accuracy: 0.809400
Epoch  5, CIFAR-10 Batch 14:  Loss:     0.5325 Validation Accuracy: 0.833400
Epoch  5, CIFAR-10 Batch 15:  Loss:     0.5686 Validation Accuracy: 0.836200
Epoch  5, CIFAR-10 Batch 16:  Loss:     0.4757 Validation Accuracy: 0.825800
Epoch  5, CIFAR-10 Batch 17:  Loss:     0.7921 Validation Accuracy: 0.832800
Epoch  5, CIFAR-10 Batch 18:  Loss:     0.4572 Validation Accuracy: 0.831000
Epoch  5, CIFAR-10 Batch 19:  Loss:     0.3786 Validation Accuracy: 0.840400
Epoch  5, CIFAR-10 Batch 20:  Loss:     0.6265 Validation Accuracy: 0.826200
Epoch  5, CIFAR-10 Batch 21:  Loss:     0.6940 Validation Accuracy: 0.816000
Epoch  5, CIFAR-10 Batch 22:  Loss:     0.5535 Validation Accuracy: 0.825200
Epoch  5, CIFAR-10 Batch 23:  Loss:     0.4832 Validation Accuracy: 0.823000
Epoch  5, CIFAR-10 Batch 24:  Loss:     0.6693 Validation Accuracy: 0.842200
Epoch  5, CIFAR-10 Batch 25:  Loss:     0.4316 Validation Accuracy: 0.835800
Epoch  5, CIFAR-10 Batch 26:  Loss:     0.4259 Validation Accuracy: 0.825800
Epoch  5, CIFAR-10 Batch 27:  Loss:     0.2982 Validation Accuracy: 0.814200
Epoch  5, CIFAR-10 Batch 28:  Loss:     0.5154 Validation Accuracy: 0.830200
Epoch  5, CIFAR-10 Batch 29:  Loss:     0.4847 Validation Accuracy: 0.820000
Epoch  5, CIFAR-10 Batch 30:  Loss:     0.3745 Validation Accuracy: 0.838200
Epoch  5, CIFAR-10 Batch 31:  Loss:     0.4282 Validation Accuracy: 0.822400
Epoch  5, CIFAR-10 Batch 32:  Loss:     0.3535 Validation Accuracy: 0.813400
Epoch  5, CIFAR-10 Batch 33:  Loss:     0.6044 Validation Accuracy: 0.827000
Epoch  5, CIFAR-10 Batch 34:  Loss:     0.7167 Validation Accuracy: 0.810600
Epoch  5, CIFAR-10 Batch 35:  Loss:     0.5300 Validation Accuracy: 0.842000
Epoch  5, CIFAR-10 Batch 36:  Loss:     0.4772 Validation Accuracy: 0.812600
Epoch  5, CIFAR-10 Batch 37:  Loss:     0.5353 Validation Accuracy: 0.843400
Epoch  5, CIFAR-10 Batch 38:  Loss:     0.3234 Validation Accuracy: 0.809600
Epoch  5, CIFAR-10 Batch 39:  Loss:     0.2873 Validation Accuracy: 0.818800
Epoch  5, CIFAR-10 Batch 40:  Loss:     0.4677 Validation Accuracy: 0.808800
Epoch  5, CIFAR-10 Batch 41:  Loss:     0.4029 Validation Accuracy: 0.831000
Epoch  5, CIFAR-10 Batch 42:  Loss:     0.5170 Validation Accuracy: 0.830600
Epoch  5, CIFAR-10 Batch 43:  Loss:     0.5555 Validation Accuracy: 0.851200
Epoch  5, CIFAR-10 Batch 44:  Loss:     0.4338 Validation Accuracy: 0.842000
Epoch  5, CIFAR-10 Batch 45:  Loss:     0.5135 Validation Accuracy: 0.831200
Epoch  5, CIFAR-10 Batch 46:  Loss:     0.5798 Validation Accuracy: 0.836600
Epoch  5, CIFAR-10 Batch 47:  Loss:     0.4500 Validation Accuracy: 0.815400
Epoch  5, CIFAR-10 Batch 48:  Loss:     0.5217 Validation Accuracy: 0.802400
Epoch  5, CIFAR-10 Batch 49:  Loss:     0.6609 Validation Accuracy: 0.831800
Epoch  5, CIFAR-10 Batch 50:  Loss:     0.4363 Validation Accuracy: 0.839600
Epoch  6, CIFAR-10 Batch 1:  Loss:     0.4590 Validation Accuracy: 0.842400
Epoch  6, CIFAR-10 Batch 2:  Loss:     0.4686 Validation Accuracy: 0.824600
Epoch  6, CIFAR-10 Batch 3:  Loss:     0.3243 Validation Accuracy: 0.846000
Epoch  6, CIFAR-10 Batch 4:  Loss:     0.3807 Validation Accuracy: 0.821200
Epoch  6, CIFAR-10 Batch 5:  Loss:     0.4010 Validation Accuracy: 0.831000
Epoch  6, CIFAR-10 Batch 6:  Loss:     0.6842 Validation Accuracy: 0.846600
Epoch  6, CIFAR-10 Batch 7:  Loss:     0.4113 Validation Accuracy: 0.820400
Epoch  6, CIFAR-10 Batch 8:  Loss:     0.6111 Validation Accuracy: 0.830400
Epoch  6, CIFAR-10 Batch 9:  Loss:     0.6279 Validation Accuracy: 0.787000
Epoch  6, CIFAR-10 Batch 10:  Loss:     0.2719 Validation Accuracy: 0.825600
Epoch  6, CIFAR-10 Batch 11:  Loss:     0.5311 Validation Accuracy: 0.837600
Epoch  6, CIFAR-10 Batch 12:  Loss:     0.5693 Validation Accuracy: 0.814400
Epoch  6, CIFAR-10 Batch 13:  Loss:     0.5855 Validation Accuracy: 0.816000
Epoch  6, CIFAR-10 Batch 14:  Loss:     0.5317 Validation Accuracy: 0.813800
Epoch  6, CIFAR-10 Batch 15:  Loss:     0.4791 Validation Accuracy: 0.852600
Epoch  6, CIFAR-10 Batch 16:  Loss:     0.4393 Validation Accuracy: 0.816600
Epoch  6, CIFAR-10 Batch 17:  Loss:     0.8256 Validation Accuracy: 0.819200
Epoch  6, CIFAR-10 Batch 18:  Loss:     0.4282 Validation Accuracy: 0.837400
Epoch  6, CIFAR-10 Batch 19:  Loss:     0.3163 Validation Accuracy: 0.824400
Epoch  6, CIFAR-10 Batch 20:  Loss:     0.5913 Validation Accuracy: 0.849800
Epoch  6, CIFAR-10 Batch 21:  Loss:     0.5890 Validation Accuracy: 0.826000
Epoch  6, CIFAR-10 Batch 22:  Loss:     0.5172 Validation Accuracy: 0.849800
Epoch  6, CIFAR-10 Batch 23:  Loss:     0.5344 Validation Accuracy: 0.840800
Epoch  6, CIFAR-10 Batch 24:  Loss:     0.4851 Validation Accuracy: 0.845800
Epoch  6, CIFAR-10 Batch 25:  Loss:     0.4210 Validation Accuracy: 0.840000
Epoch  6, CIFAR-10 Batch 26:  Loss:     0.4036 Validation Accuracy: 0.824200
Epoch  6, CIFAR-10 Batch 27:  Loss:     0.2883 Validation Accuracy: 0.823600
Epoch  6, CIFAR-10 Batch 28:  Loss:     0.4504 Validation Accuracy: 0.841800
Epoch  6, CIFAR-10 Batch 29:  Loss:     0.4263 Validation Accuracy: 0.837600
Epoch  6, CIFAR-10 Batch 30:  Loss:     0.2718 Validation Accuracy: 0.819600
Epoch  6, CIFAR-10 Batch 31:  Loss:     0.3837 Validation Accuracy: 0.812000
Epoch  6, CIFAR-10 Batch 32:  Loss:     0.3674 Validation Accuracy: 0.829200
Epoch  6, CIFAR-10 Batch 33:  Loss:     0.5338 Validation Accuracy: 0.841400
Epoch  6, CIFAR-10 Batch 34:  Loss:     0.7538 Validation Accuracy: 0.817200
Epoch  6, CIFAR-10 Batch 35:  Loss:     0.5420 Validation Accuracy: 0.848800
Epoch  6, CIFAR-10 Batch 36:  Loss:     0.4955 Validation Accuracy: 0.828800
Epoch  6, CIFAR-10 Batch 37:  Loss:     0.3870 Validation Accuracy: 0.850800
Epoch  6, CIFAR-10 Batch 38:  Loss:     0.2925 Validation Accuracy: 0.837000
Epoch  6, CIFAR-10 Batch 39:  Loss:     0.3286 Validation Accuracy: 0.840800
Epoch  6, CIFAR-10 Batch 40:  Loss:     0.3389 Validation Accuracy: 0.853800
Epoch  6, CIFAR-10 Batch 41:  Loss:     0.3307 Validation Accuracy: 0.813400
Epoch  6, CIFAR-10 Batch 42:  Loss:     0.5057 Validation Accuracy: 0.828800
Epoch  6, CIFAR-10 Batch 43:  Loss:     0.4983 Validation Accuracy: 0.846400
Epoch  6, CIFAR-10 Batch 44:  Loss:     0.4719 Validation Accuracy: 0.835800
Epoch  6, CIFAR-10 Batch 45:  Loss:     0.4763 Validation Accuracy: 0.837800
Epoch  6, CIFAR-10 Batch 46:  Loss:     0.5115 Validation Accuracy: 0.838200
Epoch  6, CIFAR-10 Batch 47:  Loss:     0.3890 Validation Accuracy: 0.844400
Epoch  6, CIFAR-10 Batch 48:  Loss:     0.4300 Validation Accuracy: 0.842200
Epoch  6, CIFAR-10 Batch 49:  Loss:     0.6427 Validation Accuracy: 0.853200
Epoch  6, CIFAR-10 Batch 50:  Loss:     0.4384 Validation Accuracy: 0.821800
Epoch  7, CIFAR-10 Batch 1:  Loss:     0.4331 Validation Accuracy: 0.838200
Epoch  7, CIFAR-10 Batch 2:  Loss:     0.3481 Validation Accuracy: 0.854600
Epoch  7, CIFAR-10 Batch 3:  Loss:     0.2791 Validation Accuracy: 0.850600
Epoch  7, CIFAR-10 Batch 4:  Loss:     0.3779 Validation Accuracy: 0.847600
Epoch  7, CIFAR-10 Batch 5:  Loss:     0.3497 Validation Accuracy: 0.829800
Epoch  7, CIFAR-10 Batch 6:  Loss:     0.6190 Validation Accuracy: 0.836600
Epoch  7, CIFAR-10 Batch 7:  Loss:     0.2906 Validation Accuracy: 0.836400
Epoch  7, CIFAR-10 Batch 8:  Loss:     0.5580 Validation Accuracy: 0.809400
Epoch  7, CIFAR-10 Batch 9:  Loss:     0.5365 Validation Accuracy: 0.824600
Epoch  7, CIFAR-10 Batch 10:  Loss:     0.1915 Validation Accuracy: 0.828400
Epoch  7, CIFAR-10 Batch 11:  Loss:     0.5590 Validation Accuracy: 0.817000
Epoch  7, CIFAR-10 Batch 12:  Loss:     0.5657 Validation Accuracy: 0.845400
Epoch  7, CIFAR-10 Batch 13:  Loss:     0.5127 Validation Accuracy: 0.854200
Epoch  7, CIFAR-10 Batch 14:  Loss:     0.4130 Validation Accuracy: 0.839600
Epoch  7, CIFAR-10 Batch 15:  Loss:     0.5009 Validation Accuracy: 0.812200
Epoch  7, CIFAR-10 Batch 16:  Loss:     0.3694 Validation Accuracy: 0.807200
Epoch  7, CIFAR-10 Batch 17:  Loss:     0.7531 Validation Accuracy: 0.842000
Epoch  7, CIFAR-10 Batch 18:  Loss:     0.3860 Validation Accuracy: 0.843600
Epoch  7, CIFAR-10 Batch 19:  Loss:     0.2709 Validation Accuracy: 0.837600
Epoch  7, CIFAR-10 Batch 20:  Loss:     0.5027 Validation Accuracy: 0.855400
Epoch  7, CIFAR-10 Batch 21:  Loss:     0.5852 Validation Accuracy: 0.825600
Epoch  7, CIFAR-10 Batch 22:  Loss:     0.5032 Validation Accuracy: 0.835400
Epoch  7, CIFAR-10 Batch 23:  Loss:     0.4622 Validation Accuracy: 0.835000
Epoch  7, CIFAR-10 Batch 24:  Loss:     0.4615 Validation Accuracy: 0.850800
Epoch  7, CIFAR-10 Batch 25:  Loss:     0.3223 Validation Accuracy: 0.832600
Epoch  7, CIFAR-10 Batch 26:  Loss:     0.3839 Validation Accuracy: 0.843400
Epoch  7, CIFAR-10 Batch 27:  Loss:     0.2645 Validation Accuracy: 0.830600
Epoch  7, CIFAR-10 Batch 28:  Loss:     0.4792 Validation Accuracy: 0.839400
Epoch  7, CIFAR-10 Batch 29:  Loss:     0.4187 Validation Accuracy: 0.831400
Epoch  7, CIFAR-10 Batch 30:  Loss:     0.3125 Validation Accuracy: 0.827000
Epoch  7, CIFAR-10 Batch 31:  Loss:     0.4214 Validation Accuracy: 0.823200
Epoch  7, CIFAR-10 Batch 32:  Loss:     0.3637 Validation Accuracy: 0.822200
Epoch  7, CIFAR-10 Batch 33:  Loss:     0.5534 Validation Accuracy: 0.845200
Epoch  7, CIFAR-10 Batch 34:  Loss:     0.6113 Validation Accuracy: 0.824000
Epoch  7, CIFAR-10 Batch 35:  Loss:     0.5260 Validation Accuracy: 0.860400
Epoch  7, CIFAR-10 Batch 36:  Loss:     0.4544 Validation Accuracy: 0.837400
Epoch  7, CIFAR-10 Batch 37:  Loss:     0.3328 Validation Accuracy: 0.840400
Epoch  7, CIFAR-10 Batch 38:  Loss:     0.2317 Validation Accuracy: 0.800400
Epoch  7, CIFAR-10 Batch 39:  Loss:     0.3149 Validation Accuracy: 0.832000
Epoch  7, CIFAR-10 Batch 40:  Loss:     0.4178 Validation Accuracy: 0.814000
Epoch  7, CIFAR-10 Batch 41:  Loss:     0.3678 Validation Accuracy: 0.831200
Epoch  7, CIFAR-10 Batch 42:  Loss:     0.3863 Validation Accuracy: 0.849000
Epoch  7, CIFAR-10 Batch 43:  Loss:     0.5393 Validation Accuracy: 0.860600
Epoch  7, CIFAR-10 Batch 44:  Loss:     0.3467 Validation Accuracy: 0.844600
Epoch  7, CIFAR-10 Batch 45:  Loss:     0.4035 Validation Accuracy: 0.839000
Epoch  7, CIFAR-10 Batch 46:  Loss:     0.5175 Validation Accuracy: 0.835000
Epoch  7, CIFAR-10 Batch 47:  Loss:     0.3769 Validation Accuracy: 0.800200
Epoch  7, CIFAR-10 Batch 48:  Loss:     0.4105 Validation Accuracy: 0.834400
Epoch  7, CIFAR-10 Batch 49:  Loss:     0.5084 Validation Accuracy: 0.840200
Epoch  7, CIFAR-10 Batch 50:  Loss:     0.3487 Validation Accuracy: 0.859800
Epoch  8, CIFAR-10 Batch 1:  Loss:     0.3892 Validation Accuracy: 0.841400
Epoch  8, CIFAR-10 Batch 2:  Loss:     0.3303 Validation Accuracy: 0.835600
Epoch  8, CIFAR-10 Batch 3:  Loss:     0.2316 Validation Accuracy: 0.841000
Epoch  8, CIFAR-10 Batch 4:  Loss:     0.3180 Validation Accuracy: 0.839200
Epoch  8, CIFAR-10 Batch 5:  Loss:     0.3407 Validation Accuracy: 0.837800
Epoch  8, CIFAR-10 Batch 6:  Loss:     0.5900 Validation Accuracy: 0.855600
Epoch  8, CIFAR-10 Batch 7:  Loss:     0.3320 Validation Accuracy: 0.818200
Epoch  8, CIFAR-10 Batch 8:  Loss:     0.4790 Validation Accuracy: 0.853000
Epoch  8, CIFAR-10 Batch 9:  Loss:     0.5298 Validation Accuracy: 0.826600
Epoch  8, CIFAR-10 Batch 10:  Loss:     0.2089 Validation Accuracy: 0.830600
Epoch  8, CIFAR-10 Batch 11:  Loss:     0.4689 Validation Accuracy: 0.838800
Epoch  8, CIFAR-10 Batch 12:  Loss:     0.5232 Validation Accuracy: 0.843000
Epoch  8, CIFAR-10 Batch 13:  Loss:     0.5110 Validation Accuracy: 0.839600
Epoch  8, CIFAR-10 Batch 14:  Loss:     0.4303 Validation Accuracy: 0.850800
Epoch  8, CIFAR-10 Batch 15:  Loss:     0.4530 Validation Accuracy: 0.836200
Epoch  8, CIFAR-10 Batch 16:  Loss:     0.2856 Validation Accuracy: 0.849000
Epoch  8, CIFAR-10 Batch 17:  Loss:     0.6988 Validation Accuracy: 0.842600
Epoch  8, CIFAR-10 Batch 18:  Loss:     0.3183 Validation Accuracy: 0.839800
Epoch  8, CIFAR-10 Batch 19:  Loss:     0.2528 Validation Accuracy: 0.852600
Epoch  8, CIFAR-10 Batch 20:  Loss:     0.5508 Validation Accuracy: 0.826800
Epoch  8, CIFAR-10 Batch 21:  Loss:     0.4591 Validation Accuracy: 0.845600
Epoch  8, CIFAR-10 Batch 22:  Loss:     0.4490 Validation Accuracy: 0.803400
Epoch  8, CIFAR-10 Batch 23:  Loss:     0.4580 Validation Accuracy: 0.829600
Epoch  8, CIFAR-10 Batch 24:  Loss:     0.4489 Validation Accuracy: 0.847000
Epoch  8, CIFAR-10 Batch 25:  Loss:     0.3658 Validation Accuracy: 0.844200
Epoch  8, CIFAR-10 Batch 26:  Loss:     0.3406 Validation Accuracy: 0.859200
Epoch  8, CIFAR-10 Batch 27:  Loss:     0.3023 Validation Accuracy: 0.756600
Epoch  8, CIFAR-10 Batch 28:  Loss:     0.4763 Validation Accuracy: 0.845400
Epoch  8, CIFAR-10 Batch 29:  Loss:     0.4288 Validation Accuracy: 0.828200
Epoch  8, CIFAR-10 Batch 30:  Loss:     0.2394 Validation Accuracy: 0.845800
Epoch  8, CIFAR-10 Batch 31:  Loss:     0.4192 Validation Accuracy: 0.828600
Epoch  8, CIFAR-10 Batch 32:  Loss:     0.3437 Validation Accuracy: 0.852200
Epoch  8, CIFAR-10 Batch 33:  Loss:     0.5344 Validation Accuracy: 0.834800
Epoch  8, CIFAR-10 Batch 34:  Loss:     0.6155 Validation Accuracy: 0.825800
Epoch  8, CIFAR-10 Batch 35:  Loss:     0.4263 Validation Accuracy: 0.850400
Epoch  8, CIFAR-10 Batch 36:  Loss:     0.4742 Validation Accuracy: 0.820200
Epoch  8, CIFAR-10 Batch 37:  Loss:     0.3354 Validation Accuracy: 0.848600
Epoch  8, CIFAR-10 Batch 38:  Loss:     0.2472 Validation Accuracy: 0.850400
Epoch  8, CIFAR-10 Batch 39:  Loss:     0.2473 Validation Accuracy: 0.848800
Epoch  8, CIFAR-10 Batch 40:  Loss:     0.4314 Validation Accuracy: 0.834600
Epoch  8, CIFAR-10 Batch 41:  Loss:     0.3559 Validation Accuracy: 0.845600
Epoch  8, CIFAR-10 Batch 42:  Loss:     0.4103 Validation Accuracy: 0.840000
Epoch  8, CIFAR-10 Batch 43:  Loss:     0.5047 Validation Accuracy: 0.855800
Epoch  8, CIFAR-10 Batch 44:  Loss:     0.4154 Validation Accuracy: 0.845000
Epoch  8, CIFAR-10 Batch 45:  Loss:     0.4341 Validation Accuracy: 0.844600
Epoch  8, CIFAR-10 Batch 46:  Loss:     0.4686 Validation Accuracy: 0.845200
Epoch  8, CIFAR-10 Batch 47:  Loss:     0.3818 Validation Accuracy: 0.849600
Epoch  8, CIFAR-10 Batch 48:  Loss:     0.3981 Validation Accuracy: 0.849400
Epoch  8, CIFAR-10 Batch 49:  Loss:     0.5187 Validation Accuracy: 0.836800
Epoch  8, CIFAR-10 Batch 50:  Loss:     0.3633 Validation Accuracy: 0.857800
Epoch  9, CIFAR-10 Batch 1:  Loss:     0.3524 Validation Accuracy: 0.866400
Epoch  9, CIFAR-10 Batch 2:  Loss:     0.3454 Validation Accuracy: 0.861400
Epoch  9, CIFAR-10 Batch 3:  Loss:     0.2747 Validation Accuracy: 0.851800
Epoch  9, CIFAR-10 Batch 4:  Loss:     0.3738 Validation Accuracy: 0.849400
Epoch  9, CIFAR-10 Batch 5:  Loss:     0.4301 Validation Accuracy: 0.826800
Epoch  9, CIFAR-10 Batch 6:  Loss:     0.5024 Validation Accuracy: 0.867400
Epoch  9, CIFAR-10 Batch 7:  Loss:     0.2683 Validation Accuracy: 0.840800
Epoch  9, CIFAR-10 Batch 8:  Loss:     0.4904 Validation Accuracy: 0.839200
Epoch  9, CIFAR-10 Batch 9:  Loss:     0.5497 Validation Accuracy: 0.850600
Epoch  9, CIFAR-10 Batch 10:  Loss:     0.2578 Validation Accuracy: 0.849600
Epoch  9, CIFAR-10 Batch 11:  Loss:     0.4463 Validation Accuracy: 0.812400
Epoch  9, CIFAR-10 Batch 12:  Loss:     0.4499 Validation Accuracy: 0.844000
Epoch  9, CIFAR-10 Batch 13:  Loss:     0.4518 Validation Accuracy: 0.842000
Epoch  9, CIFAR-10 Batch 14:  Loss:     0.3899 Validation Accuracy: 0.829200
Epoch  9, CIFAR-10 Batch 15:  Loss:     0.3914 Validation Accuracy: 0.847600
Epoch  9, CIFAR-10 Batch 16:  Loss:     0.4008 Validation Accuracy: 0.820200
Epoch  9, CIFAR-10 Batch 17:  Loss:     0.7372 Validation Accuracy: 0.852200
Epoch  9, CIFAR-10 Batch 18:  Loss:     0.3709 Validation Accuracy: 0.844000
Epoch  9, CIFAR-10 Batch 19:  Loss:     0.2066 Validation Accuracy: 0.863600
Epoch  9, CIFAR-10 Batch 20:  Loss:     0.5945 Validation Accuracy: 0.847000
Epoch  9, CIFAR-10 Batch 21:  Loss:     0.4752 Validation Accuracy: 0.849400
Epoch  9, CIFAR-10 Batch 22:  Loss:     0.3890 Validation Accuracy: 0.843000
Epoch  9, CIFAR-10 Batch 23:  Loss:     0.4415 Validation Accuracy: 0.830600
Epoch  9, CIFAR-10 Batch 24:  Loss:     0.4480 Validation Accuracy: 0.856200
Epoch  9, CIFAR-10 Batch 25:  Loss:     0.3555 Validation Accuracy: 0.829400
Epoch  9, CIFAR-10 Batch 26:  Loss:     0.3171 Validation Accuracy: 0.855600
Epoch  9, CIFAR-10 Batch 27:  Loss:     0.2677 Validation Accuracy: 0.850200
Epoch  9, CIFAR-10 Batch 28:  Loss:     0.5128 Validation Accuracy: 0.831000
Epoch  9, CIFAR-10 Batch 29:  Loss:     0.3351 Validation Accuracy: 0.850200
Epoch  9, CIFAR-10 Batch 30:  Loss:     0.2116 Validation Accuracy: 0.826200
Epoch  9, CIFAR-10 Batch 31:  Loss:     0.3839 Validation Accuracy: 0.842600
Epoch  9, CIFAR-10 Batch 32:  Loss:     0.2999 Validation Accuracy: 0.844600
Epoch  9, CIFAR-10 Batch 33:  Loss:     0.4828 Validation Accuracy: 0.811800
Epoch  9, CIFAR-10 Batch 34:  Loss:     0.6253 Validation Accuracy: 0.808600
Epoch  9, CIFAR-10 Batch 35:  Loss:     0.4875 Validation Accuracy: 0.850800
Epoch  9, CIFAR-10 Batch 36:  Loss:     0.4469 Validation Accuracy: 0.827800
Epoch  9, CIFAR-10 Batch 37:  Loss:     0.3333 Validation Accuracy: 0.837600
Epoch  9, CIFAR-10 Batch 38:  Loss:     0.1978 Validation Accuracy: 0.841800
Epoch  9, CIFAR-10 Batch 39:  Loss:     0.2308 Validation Accuracy: 0.842000
Epoch  9, CIFAR-10 Batch 40:  Loss:     0.4347 Validation Accuracy: 0.850600
Epoch  9, CIFAR-10 Batch 41:  Loss:     0.3936 Validation Accuracy: 0.816400
Epoch  9, CIFAR-10 Batch 42:  Loss:     0.3841 Validation Accuracy: 0.858400
Epoch  9, CIFAR-10 Batch 43:  Loss:     0.4685 Validation Accuracy: 0.866400
Epoch  9, CIFAR-10 Batch 44:  Loss:     0.3660 Validation Accuracy: 0.844200
Epoch  9, CIFAR-10 Batch 45:  Loss:     0.3100 Validation Accuracy: 0.855800
Epoch  9, CIFAR-10 Batch 46:  Loss:     0.4226 Validation Accuracy: 0.859200
Epoch  9, CIFAR-10 Batch 47:  Loss:     0.3315 Validation Accuracy: 0.842600
Epoch  9, CIFAR-10 Batch 48:  Loss:     0.3950 Validation Accuracy: 0.855400
Epoch  9, CIFAR-10 Batch 49:  Loss:     0.4228 Validation Accuracy: 0.848600
Epoch  9, CIFAR-10 Batch 50:  Loss:     0.3648 Validation Accuracy: 0.849400
Epoch 10, CIFAR-10 Batch 1:  Loss:     0.2977 Validation Accuracy: 0.858400
Epoch 10, CIFAR-10 Batch 2:  Loss:     0.3486 Validation Accuracy: 0.857800
Epoch 10, CIFAR-10 Batch 3:  Loss:     0.2942 Validation Accuracy: 0.853200
Epoch 10, CIFAR-10 Batch 4:  Loss:     0.2576 Validation Accuracy: 0.837400
Epoch 10, CIFAR-10 Batch 5:  Loss:     0.2795 Validation Accuracy: 0.852000
Epoch 10, CIFAR-10 Batch 6:  Loss:     0.5280 Validation Accuracy: 0.854200
Epoch 10, CIFAR-10 Batch 7:  Loss:     0.2567 Validation Accuracy: 0.821200
Epoch 10, CIFAR-10 Batch 8:  Loss:     0.5411 Validation Accuracy: 0.856400
Epoch 10, CIFAR-10 Batch 9:  Loss:     0.4729 Validation Accuracy: 0.838600
Epoch 10, CIFAR-10 Batch 10:  Loss:     0.2038 Validation Accuracy: 0.861800
Epoch 10, CIFAR-10 Batch 11:  Loss:     0.4531 Validation Accuracy: 0.832400
Epoch 10, CIFAR-10 Batch 12:  Loss:     0.4225 Validation Accuracy: 0.851800
Epoch 10, CIFAR-10 Batch 13:  Loss:     0.3243 Validation Accuracy: 0.837400
Epoch 10, CIFAR-10 Batch 14:  Loss:     0.3323 Validation Accuracy: 0.826600
Epoch 10, CIFAR-10 Batch 15:  Loss:     0.4374 Validation Accuracy: 0.837800
Epoch 10, CIFAR-10 Batch 16:  Loss:     0.2916 Validation Accuracy: 0.841800
Epoch 10, CIFAR-10 Batch 17:  Loss:     0.6768 Validation Accuracy: 0.854800
Epoch 10, CIFAR-10 Batch 18:  Loss:     0.2871 Validation Accuracy: 0.851400
Epoch 10, CIFAR-10 Batch 19:  Loss:     0.2426 Validation Accuracy: 0.814400
Epoch 10, CIFAR-10 Batch 20:  Loss:     0.5448 Validation Accuracy: 0.851200
Epoch 10, CIFAR-10 Batch 21:  Loss:     0.4201 Validation Accuracy: 0.840400
Epoch 10, CIFAR-10 Batch 22:  Loss:     0.3929 Validation Accuracy: 0.844800
Epoch 10, CIFAR-10 Batch 23:  Loss:     0.5206 Validation Accuracy: 0.863400
Epoch 10, CIFAR-10 Batch 24:  Loss:     0.3950 Validation Accuracy: 0.843800
Epoch 10, CIFAR-10 Batch 25:  Loss:     0.2614 Validation Accuracy: 0.843600
Epoch 10, CIFAR-10 Batch 26:  Loss:     0.3187 Validation Accuracy: 0.838200
Epoch 10, CIFAR-10 Batch 27:  Loss:     0.2350 Validation Accuracy: 0.841600
Epoch 10, CIFAR-10 Batch 28:  Loss:     0.4792 Validation Accuracy: 0.858400
Epoch 10, CIFAR-10 Batch 29:  Loss:     0.3352 Validation Accuracy: 0.851600
Epoch 10, CIFAR-10 Batch 30:  Loss:     0.2529 Validation Accuracy: 0.844200
Epoch 10, CIFAR-10 Batch 31:  Loss:     0.3483 Validation Accuracy: 0.828200
Epoch 10, CIFAR-10 Batch 32:  Loss:     0.3042 Validation Accuracy: 0.845600
Epoch 10, CIFAR-10 Batch 33:  Loss:     0.4638 Validation Accuracy: 0.856600
Epoch 10, CIFAR-10 Batch 34:  Loss:     0.5603 Validation Accuracy: 0.854000
Epoch 10, CIFAR-10 Batch 35:  Loss:     0.4649 Validation Accuracy: 0.862200
Epoch 10, CIFAR-10 Batch 36:  Loss:     0.4694 Validation Accuracy: 0.840800
Epoch 10, CIFAR-10 Batch 37:  Loss:     0.3418 Validation Accuracy: 0.860200
Epoch 10, CIFAR-10 Batch 38:  Loss:     0.1993 Validation Accuracy: 0.831600
Epoch 10, CIFAR-10 Batch 39:  Loss:     0.2177 Validation Accuracy: 0.839600
Epoch 10, CIFAR-10 Batch 40:  Loss:     0.3426 Validation Accuracy: 0.848800
Epoch 10, CIFAR-10 Batch 41:  Loss:     0.3567 Validation Accuracy: 0.826600
Epoch 10, CIFAR-10 Batch 42:  Loss:     0.3927 Validation Accuracy: 0.857000
Epoch 10, CIFAR-10 Batch 43:  Loss:     0.4352 Validation Accuracy: 0.847000
Epoch 10, CIFAR-10 Batch 44:  Loss:     0.3499 Validation Accuracy: 0.863200
Epoch 10, CIFAR-10 Batch 45:  Loss:     0.3625 Validation Accuracy: 0.848600
Epoch 10, CIFAR-10 Batch 46:  Loss:     0.4009 Validation Accuracy: 0.833000
Epoch 10, CIFAR-10 Batch 47:  Loss:     0.3134 Validation Accuracy: 0.850800
Epoch 10, CIFAR-10 Batch 48:  Loss:     0.3457 Validation Accuracy: 0.838600
Epoch 10, CIFAR-10 Batch 49:  Loss:     0.4525 Validation Accuracy: 0.848200
Epoch 10, CIFAR-10 Batch 50:  Loss:     0.3512 Validation Accuracy: 0.831800
Epoch 11, CIFAR-10 Batch 1:  Loss:     0.2502 Validation Accuracy: 0.857400
Epoch 11, CIFAR-10 Batch 2:  Loss:     0.3100 Validation Accuracy: 0.824800
Epoch 11, CIFAR-10 Batch 3:  Loss:     0.2525 Validation Accuracy: 0.864000
Epoch 11, CIFAR-10 Batch 4:  Loss:     0.2375 Validation Accuracy: 0.864400
Epoch 11, CIFAR-10 Batch 5:  Loss:     0.3323 Validation Accuracy: 0.854000
Epoch 11, CIFAR-10 Batch 6:  Loss:     0.5657 Validation Accuracy: 0.856800
Epoch 11, CIFAR-10 Batch 7:  Loss:     0.2541 Validation Accuracy: 0.849000
Epoch 11, CIFAR-10 Batch 8:  Loss:     0.5286 Validation Accuracy: 0.859800
Epoch 11, CIFAR-10 Batch 9:  Loss:     0.4444 Validation Accuracy: 0.848000
Epoch 11, CIFAR-10 Batch 10:  Loss:     0.1705 Validation Accuracy: 0.837200
Epoch 11, CIFAR-10 Batch 11:  Loss:     0.3374 Validation Accuracy: 0.844000
Epoch 11, CIFAR-10 Batch 12:  Loss:     0.4544 Validation Accuracy: 0.840400
Epoch 11, CIFAR-10 Batch 13:  Loss:     0.3766 Validation Accuracy: 0.851200
Epoch 11, CIFAR-10 Batch 14:  Loss:     0.3606 Validation Accuracy: 0.834000
Epoch 11, CIFAR-10 Batch 15:  Loss:     0.3186 Validation Accuracy: 0.858800
Epoch 11, CIFAR-10 Batch 16:  Loss:     0.2891 Validation Accuracy: 0.838000
Epoch 11, CIFAR-10 Batch 17:  Loss:     0.6086 Validation Accuracy: 0.863200
Epoch 11, CIFAR-10 Batch 18:  Loss:     0.3369 Validation Accuracy: 0.841000
Epoch 11, CIFAR-10 Batch 19:  Loss:     0.2723 Validation Accuracy: 0.854800
Epoch 11, CIFAR-10 Batch 20:  Loss:     0.4811 Validation Accuracy: 0.847400
Epoch 11, CIFAR-10 Batch 21:  Loss:     0.4163 Validation Accuracy: 0.853800
Epoch 11, CIFAR-10 Batch 22:  Loss:     0.3757 Validation Accuracy: 0.853000
Epoch 11, CIFAR-10 Batch 23:  Loss:     0.4238 Validation Accuracy: 0.850200
Epoch 11, CIFAR-10 Batch 24:  Loss:     0.3573 Validation Accuracy: 0.858600
Epoch 11, CIFAR-10 Batch 25:  Loss:     0.3090 Validation Accuracy: 0.849800
Epoch 11, CIFAR-10 Batch 26:  Loss:     0.2653 Validation Accuracy: 0.850000
Epoch 11, CIFAR-10 Batch 27:  Loss:     0.2845 Validation Accuracy: 0.854400
Epoch 11, CIFAR-10 Batch 28:  Loss:     0.4185 Validation Accuracy: 0.854800
Epoch 11, CIFAR-10 Batch 29:  Loss:     0.3849 Validation Accuracy: 0.842000
Epoch 11, CIFAR-10 Batch 30:  Loss:     0.2236 Validation Accuracy: 0.849800
Epoch 11, CIFAR-10 Batch 31:  Loss:     0.2871 Validation Accuracy: 0.842400
Epoch 11, CIFAR-10 Batch 32:  Loss:     0.2533 Validation Accuracy: 0.852600
Epoch 11, CIFAR-10 Batch 33:  Loss:     0.5032 Validation Accuracy: 0.842800
Epoch 11, CIFAR-10 Batch 34:  Loss:     0.5642 Validation Accuracy: 0.842400
Epoch 11, CIFAR-10 Batch 35:  Loss:     0.4222 Validation Accuracy: 0.847200
Epoch 11, CIFAR-10 Batch 36:  Loss:     0.4296 Validation Accuracy: 0.841400
Epoch 11, CIFAR-10 Batch 37:  Loss:     0.3272 Validation Accuracy: 0.832400
Epoch 11, CIFAR-10 Batch 38:  Loss:     0.1902 Validation Accuracy: 0.851200
Epoch 11, CIFAR-10 Batch 39:  Loss:     0.2197 Validation Accuracy: 0.841000
Epoch 11, CIFAR-10 Batch 40:  Loss:     0.4504 Validation Accuracy: 0.853200
Epoch 11, CIFAR-10 Batch 41:  Loss:     0.3230 Validation Accuracy: 0.840200
Epoch 11, CIFAR-10 Batch 42:  Loss:     0.2970 Validation Accuracy: 0.848400
Epoch 11, CIFAR-10 Batch 43:  Loss:     0.4373 Validation Accuracy: 0.858800
Epoch 11, CIFAR-10 Batch 44:  Loss:     0.3162 Validation Accuracy: 0.870000
Epoch 11, CIFAR-10 Batch 45:  Loss:     0.3614 Validation Accuracy: 0.836000
Epoch 11, CIFAR-10 Batch 46:  Loss:     0.4423 Validation Accuracy: 0.855200
Epoch 11, CIFAR-10 Batch 47:  Loss:     0.2805 Validation Accuracy: 0.855200
Epoch 11, CIFAR-10 Batch 48:  Loss:     0.3554 Validation Accuracy: 0.856400
Epoch 11, CIFAR-10 Batch 49:  Loss:     0.4075 Validation Accuracy: 0.828000
Epoch 11, CIFAR-10 Batch 50:  Loss:     0.3152 Validation Accuracy: 0.850000
Epoch 12, CIFAR-10 Batch 1:  Loss:     0.2770 Validation Accuracy: 0.853600
Epoch 12, CIFAR-10 Batch 2:  Loss:     0.2896 Validation Accuracy: 0.856600
Epoch 12, CIFAR-10 Batch 3:  Loss:     0.2312 Validation Accuracy: 0.867400
Epoch 12, CIFAR-10 Batch 4:  Loss:     0.2774 Validation Accuracy: 0.856000
Epoch 12, CIFAR-10 Batch 5:  Loss:     0.3528 Validation Accuracy: 0.850000
Epoch 12, CIFAR-10 Batch 6:  Loss:     0.4413 Validation Accuracy: 0.857600
Epoch 12, CIFAR-10 Batch 7:  Loss:     0.2856 Validation Accuracy: 0.848200
Epoch 12, CIFAR-10 Batch 8:  Loss:     0.4256 Validation Accuracy: 0.853400
Epoch 12, CIFAR-10 Batch 9:  Loss:     0.4678 Validation Accuracy: 0.853400
Epoch 12, CIFAR-10 Batch 10:  Loss:     0.1429 Validation Accuracy: 0.848200
Epoch 12, CIFAR-10 Batch 11:  Loss:     0.4050 Validation Accuracy: 0.853200
Epoch 12, CIFAR-10 Batch 12:  Loss:     0.3353 Validation Accuracy: 0.821000
Epoch 12, CIFAR-10 Batch 13:  Loss:     0.3631 Validation Accuracy: 0.845400
Epoch 12, CIFAR-10 Batch 14:  Loss:     0.4349 Validation Accuracy: 0.852000
Epoch 12, CIFAR-10 Batch 15:  Loss:     0.3190 Validation Accuracy: 0.852000
Epoch 12, CIFAR-10 Batch 16:  Loss:     0.3259 Validation Accuracy: 0.828000
Epoch 12, CIFAR-10 Batch 17:  Loss:     0.5507 Validation Accuracy: 0.865600
Epoch 12, CIFAR-10 Batch 18:  Loss:     0.2910 Validation Accuracy: 0.842000
Epoch 12, CIFAR-10 Batch 19:  Loss:     0.2177 Validation Accuracy: 0.863000
Epoch 12, CIFAR-10 Batch 20:  Loss:     0.5055 Validation Accuracy: 0.846800
Epoch 12, CIFAR-10 Batch 21:  Loss:     0.3628 Validation Accuracy: 0.854200
Epoch 12, CIFAR-10 Batch 22:  Loss:     0.3301 Validation Accuracy: 0.848600
Epoch 12, CIFAR-10 Batch 23:  Loss:     0.4357 Validation Accuracy: 0.853000
Epoch 12, CIFAR-10 Batch 24:  Loss:     0.4005 Validation Accuracy: 0.853000
Epoch 12, CIFAR-10 Batch 25:  Loss:     0.3824 Validation Accuracy: 0.844200
Epoch 12, CIFAR-10 Batch 26:  Loss:     0.2794 Validation Accuracy: 0.864600
Epoch 12, CIFAR-10 Batch 27:  Loss:     0.2257 Validation Accuracy: 0.848800
Epoch 12, CIFAR-10 Batch 28:  Loss:     0.4497 Validation Accuracy: 0.849800
Epoch 12, CIFAR-10 Batch 29:  Loss:     0.3129 Validation Accuracy: 0.836200
Epoch 12, CIFAR-10 Batch 30:  Loss:     0.2499 Validation Accuracy: 0.816800
Epoch 12, CIFAR-10 Batch 31:  Loss:     0.2701 Validation Accuracy: 0.848800
Epoch 12, CIFAR-10 Batch 32:  Loss:     0.2351 Validation Accuracy: 0.864800
Epoch 12, CIFAR-10 Batch 33:  Loss:     0.4275 Validation Accuracy: 0.862600
Epoch 12, CIFAR-10 Batch 34:  Loss:     0.5722 Validation Accuracy: 0.818600
Epoch 12, CIFAR-10 Batch 35:  Loss:     0.4616 Validation Accuracy: 0.856800
Epoch 12, CIFAR-10 Batch 36:  Loss:     0.4225 Validation Accuracy: 0.839400
Epoch 12, CIFAR-10 Batch 37:  Loss:     0.3034 Validation Accuracy: 0.856200
Epoch 12, CIFAR-10 Batch 38:  Loss:     0.2087 Validation Accuracy: 0.861000
Epoch 12, CIFAR-10 Batch 39:  Loss:     0.2122 Validation Accuracy: 0.855800
Epoch 12, CIFAR-10 Batch 40:  Loss:     0.4362 Validation Accuracy: 0.845400
Epoch 12, CIFAR-10 Batch 41:  Loss:     0.2627 Validation Accuracy: 0.844800
Epoch 12, CIFAR-10 Batch 42:  Loss:     0.3401 Validation Accuracy: 0.871400
Epoch 12, CIFAR-10 Batch 43:  Loss:     0.4008 Validation Accuracy: 0.865200
Epoch 12, CIFAR-10 Batch 44:  Loss:     0.3243 Validation Accuracy: 0.845800
Epoch 12, CIFAR-10 Batch 45:  Loss:     0.3718 Validation Accuracy: 0.860400
Epoch 12, CIFAR-10 Batch 46:  Loss:     0.3943 Validation Accuracy: 0.862800
Epoch 12, CIFAR-10 Batch 47:  Loss:     0.2431 Validation Accuracy: 0.865200
Epoch 12, CIFAR-10 Batch 48:  Loss:     0.3493 Validation Accuracy: 0.835400
Epoch 12, CIFAR-10 Batch 49:  Loss:     0.4225 Validation Accuracy: 0.860400
Epoch 12, CIFAR-10 Batch 50:  Loss:     0.3436 Validation Accuracy: 0.858600
Epoch 13, CIFAR-10 Batch 1:  Loss:     0.2709 Validation Accuracy: 0.860000
Epoch 13, CIFAR-10 Batch 2:  Loss:     0.2715 Validation Accuracy: 0.834000
Epoch 13, CIFAR-10 Batch 3:  Loss:     0.2381 Validation Accuracy: 0.860000
Epoch 13, CIFAR-10 Batch 4:  Loss:     0.2170 Validation Accuracy: 0.843800
Epoch 13, CIFAR-10 Batch 5:  Loss:     0.3674 Validation Accuracy: 0.845000
Epoch 13, CIFAR-10 Batch 6:  Loss:     0.5540 Validation Accuracy: 0.835000
Epoch 13, CIFAR-10 Batch 7:  Loss:     0.2490 Validation Accuracy: 0.858800
Epoch 13, CIFAR-10 Batch 8:  Loss:     0.4656 Validation Accuracy: 0.861200
Epoch 13, CIFAR-10 Batch 9:  Loss:     0.4005 Validation Accuracy: 0.855200
Epoch 13, CIFAR-10 Batch 10:  Loss:     0.2023 Validation Accuracy: 0.855000
Epoch 13, CIFAR-10 Batch 11:  Loss:     0.3553 Validation Accuracy: 0.845800
Epoch 13, CIFAR-10 Batch 12:  Loss:     0.4087 Validation Accuracy: 0.855600
Epoch 13, CIFAR-10 Batch 13:  Loss:     0.4130 Validation Accuracy: 0.839000
Epoch 13, CIFAR-10 Batch 14:  Loss:     0.3762 Validation Accuracy: 0.859200
Epoch 13, CIFAR-10 Batch 15:  Loss:     0.2696 Validation Accuracy: 0.860400
Epoch 13, CIFAR-10 Batch 16:  Loss:     0.3102 Validation Accuracy: 0.856200
Epoch 13, CIFAR-10 Batch 17:  Loss:     0.5722 Validation Accuracy: 0.864800
Epoch 13, CIFAR-10 Batch 18:  Loss:     0.2609 Validation Accuracy: 0.866400
Epoch 13, CIFAR-10 Batch 19:  Loss:     0.2327 Validation Accuracy: 0.857600
Epoch 13, CIFAR-10 Batch 20:  Loss:     0.4147 Validation Accuracy: 0.856200
Epoch 13, CIFAR-10 Batch 21:  Loss:     0.3292 Validation Accuracy: 0.841800
Epoch 13, CIFAR-10 Batch 22:  Loss:     0.3052 Validation Accuracy: 0.851800
Epoch 13, CIFAR-10 Batch 23:  Loss:     0.3826 Validation Accuracy: 0.837800
Epoch 13, CIFAR-10 Batch 24:  Loss:     0.3708 Validation Accuracy: 0.859600
Epoch 13, CIFAR-10 Batch 25:  Loss:     0.3156 Validation Accuracy: 0.863400
Epoch 13, CIFAR-10 Batch 26:  Loss:     0.2820 Validation Accuracy: 0.864200
Epoch 13, CIFAR-10 Batch 27:  Loss:     0.2260 Validation Accuracy: 0.846000
Epoch 13, CIFAR-10 Batch 28:  Loss:     0.5134 Validation Accuracy: 0.861200
Epoch 13, CIFAR-10 Batch 29:  Loss:     0.3591 Validation Accuracy: 0.845200
Epoch 13, CIFAR-10 Batch 30:  Loss:     0.1954 Validation Accuracy: 0.855000
Epoch 13, CIFAR-10 Batch 31:  Loss:     0.2511 Validation Accuracy: 0.846800
Epoch 13, CIFAR-10 Batch 32:  Loss:     0.2587 Validation Accuracy: 0.847000
Epoch 13, CIFAR-10 Batch 33:  Loss:     0.5337 Validation Accuracy: 0.848000
Epoch 13, CIFAR-10 Batch 34:  Loss:     0.5001 Validation Accuracy: 0.833000
Epoch 13, CIFAR-10 Batch 35:  Loss:     0.4173 Validation Accuracy: 0.854000
Epoch 13, CIFAR-10 Batch 36:  Loss:     0.3981 Validation Accuracy: 0.836200
Epoch 13, CIFAR-10 Batch 37:  Loss:     0.2929 Validation Accuracy: 0.847000
Epoch 13, CIFAR-10 Batch 38:  Loss:     0.1747 Validation Accuracy: 0.845000
Epoch 13, CIFAR-10 Batch 39:  Loss:     0.1872 Validation Accuracy: 0.834400
Epoch 13, CIFAR-10 Batch 40:  Loss:     0.4760 Validation Accuracy: 0.844600
Epoch 13, CIFAR-10 Batch 41:  Loss:     0.2751 Validation Accuracy: 0.842400
Epoch 13, CIFAR-10 Batch 42:  Loss:     0.3197 Validation Accuracy: 0.869600
Epoch 13, CIFAR-10 Batch 43:  Loss:     0.3658 Validation Accuracy: 0.874000
Epoch 13, CIFAR-10 Batch 44:  Loss:     0.3782 Validation Accuracy: 0.863400
Epoch 13, CIFAR-10 Batch 45:  Loss:     0.3529 Validation Accuracy: 0.855000
Epoch 13, CIFAR-10 Batch 46:  Loss:     0.3891 Validation Accuracy: 0.855000
Epoch 13, CIFAR-10 Batch 47:  Loss:     0.2919 Validation Accuracy: 0.850600
Epoch 13, CIFAR-10 Batch 48:  Loss:     0.3230 Validation Accuracy: 0.870600
Epoch 13, CIFAR-10 Batch 49:  Loss:     0.3613 Validation Accuracy: 0.848000
Epoch 13, CIFAR-10 Batch 50:  Loss:     0.3062 Validation Accuracy: 0.868200
Epoch 14, CIFAR-10 Batch 1:  Loss:     0.2791 Validation Accuracy: 0.864000
Epoch 14, CIFAR-10 Batch 2:  Loss:     0.2792 Validation Accuracy: 0.848000
Epoch 14, CIFAR-10 Batch 3:  Loss:     0.2678 Validation Accuracy: 0.873600
Epoch 14, CIFAR-10 Batch 4:  Loss:     0.2404 Validation Accuracy: 0.863000
Epoch 14, CIFAR-10 Batch 5:  Loss:     0.3194 Validation Accuracy: 0.849200
Epoch 14, CIFAR-10 Batch 6:  Loss:     0.5063 Validation Accuracy: 0.860000
Epoch 14, CIFAR-10 Batch 7:  Loss:     0.2422 Validation Accuracy: 0.849400
Epoch 14, CIFAR-10 Batch 8:  Loss:     0.3905 Validation Accuracy: 0.854400
Epoch 14, CIFAR-10 Batch 9:  Loss:     0.3814 Validation Accuracy: 0.856600
Epoch 14, CIFAR-10 Batch 10:  Loss:     0.1842 Validation Accuracy: 0.857200
Epoch 14, CIFAR-10 Batch 11:  Loss:     0.3414 Validation Accuracy: 0.864200
Epoch 14, CIFAR-10 Batch 12:  Loss:     0.3486 Validation Accuracy: 0.866800
Epoch 14, CIFAR-10 Batch 13:  Loss:     0.4136 Validation Accuracy: 0.828600
Epoch 14, CIFAR-10 Batch 14:  Loss:     0.3231 Validation Accuracy: 0.852800
Epoch 14, CIFAR-10 Batch 15:  Loss:     0.3387 Validation Accuracy: 0.867200
Epoch 14, CIFAR-10 Batch 16:  Loss:     0.2153 Validation Accuracy: 0.799400
Epoch 14, CIFAR-10 Batch 17:  Loss:     0.5469 Validation Accuracy: 0.869200
Epoch 14, CIFAR-10 Batch 18:  Loss:     0.2853 Validation Accuracy: 0.853000
Epoch 14, CIFAR-10 Batch 19:  Loss:     0.2824 Validation Accuracy: 0.857400
Epoch 14, CIFAR-10 Batch 20:  Loss:     0.5016 Validation Accuracy: 0.843400
Epoch 14, CIFAR-10 Batch 21:  Loss:     0.3532 Validation Accuracy: 0.857200
Epoch 14, CIFAR-10 Batch 22:  Loss:     0.3404 Validation Accuracy: 0.865400
Epoch 14, CIFAR-10 Batch 23:  Loss:     0.3870 Validation Accuracy: 0.855000
Epoch 14, CIFAR-10 Batch 24:  Loss:     0.3529 Validation Accuracy: 0.857600
Epoch 14, CIFAR-10 Batch 25:  Loss:     0.3110 Validation Accuracy: 0.841000
Epoch 14, CIFAR-10 Batch 26:  Loss:     0.2503 Validation Accuracy: 0.869600
Epoch 14, CIFAR-10 Batch 27:  Loss:     0.1934 Validation Accuracy: 0.845400
Epoch 14, CIFAR-10 Batch 28:  Loss:     0.4501 Validation Accuracy: 0.853400
Epoch 14, CIFAR-10 Batch 29:  Loss:     0.2983 Validation Accuracy: 0.851200
Epoch 14, CIFAR-10 Batch 30:  Loss:     0.1832 Validation Accuracy: 0.857000
Epoch 14, CIFAR-10 Batch 31:  Loss:     0.2903 Validation Accuracy: 0.852600
Epoch 14, CIFAR-10 Batch 32:  Loss:     0.2708 Validation Accuracy: 0.861800
Epoch 14, CIFAR-10 Batch 33:  Loss:     0.4279 Validation Accuracy: 0.863400
Epoch 14, CIFAR-10 Batch 34:  Loss:     0.5495 Validation Accuracy: 0.837600
Epoch 14, CIFAR-10 Batch 35:  Loss:     0.3781 Validation Accuracy: 0.862800
Epoch 14, CIFAR-10 Batch 36:  Loss:     0.4073 Validation Accuracy: 0.815000
Epoch 14, CIFAR-10 Batch 37:  Loss:     0.2305 Validation Accuracy: 0.865800
Epoch 14, CIFAR-10 Batch 38:  Loss:     0.1875 Validation Accuracy: 0.847600
Epoch 14, CIFAR-10 Batch 39:  Loss:     0.1696 Validation Accuracy: 0.849400
Epoch 14, CIFAR-10 Batch 40:  Loss:     0.3729 Validation Accuracy: 0.865600
Epoch 14, CIFAR-10 Batch 41:  Loss:     0.2935 Validation Accuracy: 0.853000
Epoch 14, CIFAR-10 Batch 42:  Loss:     0.2967 Validation Accuracy: 0.862400
Epoch 14, CIFAR-10 Batch 43:  Loss:     0.3791 Validation Accuracy: 0.870400
Epoch 14, CIFAR-10 Batch 44:  Loss:     0.3377 Validation Accuracy: 0.868800
Epoch 14, CIFAR-10 Batch 45:  Loss:     0.3852 Validation Accuracy: 0.859000
Epoch 14, CIFAR-10 Batch 46:  Loss:     0.3787 Validation Accuracy: 0.854200
Epoch 14, CIFAR-10 Batch 47:  Loss:     0.3250 Validation Accuracy: 0.859200
Epoch 14, CIFAR-10 Batch 48:  Loss:     0.3271 Validation Accuracy: 0.838000
Epoch 14, CIFAR-10 Batch 49:  Loss:     0.2935 Validation Accuracy: 0.871000
Epoch 14, CIFAR-10 Batch 50:  Loss:     0.2752 Validation Accuracy: 0.844800
Epoch 15, CIFAR-10 Batch 1:  Loss:     0.3218 Validation Accuracy: 0.871600
Epoch 15, CIFAR-10 Batch 2:  Loss:     0.2373 Validation Accuracy: 0.866400
Epoch 15, CIFAR-10 Batch 3:  Loss:     0.2485 Validation Accuracy: 0.865400
Epoch 15, CIFAR-10 Batch 4:  Loss:     0.2461 Validation Accuracy: 0.850000
Epoch 15, CIFAR-10 Batch 5:  Loss:     0.2957 Validation Accuracy: 0.850600
Epoch 15, CIFAR-10 Batch 6:  Loss:     0.4380 Validation Accuracy: 0.865600
Epoch 15, CIFAR-10 Batch 7:  Loss:     0.2947 Validation Accuracy: 0.847000
Epoch 15, CIFAR-10 Batch 8:  Loss:     0.3224 Validation Accuracy: 0.856400
Epoch 15, CIFAR-10 Batch 9:  Loss:     0.3488 Validation Accuracy: 0.857400
Epoch 15, CIFAR-10 Batch 10:  Loss:     0.2166 Validation Accuracy: 0.860600
Epoch 15, CIFAR-10 Batch 11:  Loss:     0.3076 Validation Accuracy: 0.855600
Epoch 15, CIFAR-10 Batch 12:  Loss:     0.4517 Validation Accuracy: 0.841200
Epoch 15, CIFAR-10 Batch 13:  Loss:     0.3066 Validation Accuracy: 0.856600
Epoch 15, CIFAR-10 Batch 14:  Loss:     0.3906 Validation Accuracy: 0.850400
Epoch 15, CIFAR-10 Batch 15:  Loss:     0.3357 Validation Accuracy: 0.855200
Epoch 15, CIFAR-10 Batch 16:  Loss:     0.2748 Validation Accuracy: 0.846000
Epoch 15, CIFAR-10 Batch 17:  Loss:     0.5228 Validation Accuracy: 0.859600
Epoch 15, CIFAR-10 Batch 18:  Loss:     0.2792 Validation Accuracy: 0.839600
Epoch 15, CIFAR-10 Batch 19:  Loss:     0.2425 Validation Accuracy: 0.866800
Epoch 15, CIFAR-10 Batch 20:  Loss:     0.3899 Validation Accuracy: 0.861800
Epoch 15, CIFAR-10 Batch 21:  Loss:     0.3178 Validation Accuracy: 0.858200
Epoch 15, CIFAR-10 Batch 22:  Loss:     0.3282 Validation Accuracy: 0.855000
Epoch 15, CIFAR-10 Batch 23:  Loss:     0.3688 Validation Accuracy: 0.860400
Epoch 15, CIFAR-10 Batch 24:  Loss:     0.3248 Validation Accuracy: 0.860000
Epoch 15, CIFAR-10 Batch 25:  Loss:     0.3402 Validation Accuracy: 0.860600
Epoch 15, CIFAR-10 Batch 26:  Loss:     0.2351 Validation Accuracy: 0.872000
Epoch 15, CIFAR-10 Batch 27:  Loss:     0.1863 Validation Accuracy: 0.838000
Epoch 15, CIFAR-10 Batch 28:  Loss:     0.3803 Validation Accuracy: 0.853800
Epoch 15, CIFAR-10 Batch 29:  Loss:     0.2668 Validation Accuracy: 0.868800
Epoch 15, CIFAR-10 Batch 30:  Loss:     0.2038 Validation Accuracy: 0.855200
Epoch 15, CIFAR-10 Batch 31:  Loss:     0.2916 Validation Accuracy: 0.829400
Epoch 15, CIFAR-10 Batch 32:  Loss:     0.2110 Validation Accuracy: 0.847600
Epoch 15, CIFAR-10 Batch 33:  Loss:     0.4758 Validation Accuracy: 0.817400
Epoch 15, CIFAR-10 Batch 34:  Loss:     0.5414 Validation Accuracy: 0.839400
Epoch 15, CIFAR-10 Batch 35:  Loss:     0.4139 Validation Accuracy: 0.863400
Epoch 15, CIFAR-10 Batch 36:  Loss:     0.3946 Validation Accuracy: 0.850000
Epoch 15, CIFAR-10 Batch 37:  Loss:     0.2285 Validation Accuracy: 0.862400
Epoch 15, CIFAR-10 Batch 38:  Loss:     0.1937 Validation Accuracy: 0.827600
Epoch 15, CIFAR-10 Batch 39:  Loss:     0.2121 Validation Accuracy: 0.847800
Epoch 15, CIFAR-10 Batch 40:  Loss:     0.4419 Validation Accuracy: 0.848200
Epoch 15, CIFAR-10 Batch 41:  Loss:     0.2971 Validation Accuracy: 0.836200
Epoch 15, CIFAR-10 Batch 42:  Loss:     0.3402 Validation Accuracy: 0.864000
Epoch 15, CIFAR-10 Batch 43:  Loss:     0.4027 Validation Accuracy: 0.867600
Epoch 15, CIFAR-10 Batch 44:  Loss:     0.3334 Validation Accuracy: 0.873000
Epoch 15, CIFAR-10 Batch 45:  Loss:     0.3311 Validation Accuracy: 0.862000
Epoch 15, CIFAR-10 Batch 46:  Loss:     0.3511 Validation Accuracy: 0.858600
Epoch 15, CIFAR-10 Batch 47:  Loss:     0.2422 Validation Accuracy: 0.871600
Epoch 15, CIFAR-10 Batch 48:  Loss:     0.3588 Validation Accuracy: 0.857600
Epoch 15, CIFAR-10 Batch 49:  Loss:     0.3872 Validation Accuracy: 0.853800
Epoch 15, CIFAR-10 Batch 50:  Loss:     0.3263 Validation Accuracy: 0.852600
Epoch 16, CIFAR-10 Batch 1:  Loss:     0.2408 Validation Accuracy: 0.864000
Epoch 16, CIFAR-10 Batch 2:  Loss:     0.1907 Validation Accuracy: 0.825200
Epoch 16, CIFAR-10 Batch 3:  Loss:     0.2370 Validation Accuracy: 0.869000
Epoch 16, CIFAR-10 Batch 4:  Loss:     0.1947 Validation Accuracy: 0.871800
Epoch 16, CIFAR-10 Batch 5:  Loss:     0.3148 Validation Accuracy: 0.866000
Epoch 16, CIFAR-10 Batch 6:  Loss:     0.5190 Validation Accuracy: 0.864600
Epoch 16, CIFAR-10 Batch 7:  Loss:     0.2693 Validation Accuracy: 0.845800
Epoch 16, CIFAR-10 Batch 8:  Loss:     0.3770 Validation Accuracy: 0.854400
Epoch 16, CIFAR-10 Batch 9:  Loss:     0.3521 Validation Accuracy: 0.859400
Epoch 16, CIFAR-10 Batch 10:  Loss:     0.2543 Validation Accuracy: 0.848600
Epoch 16, CIFAR-10 Batch 11:  Loss:     0.3737 Validation Accuracy: 0.865800
Epoch 16, CIFAR-10 Batch 12:  Loss:     0.3715 Validation Accuracy: 0.859200
Epoch 16, CIFAR-10 Batch 13:  Loss:     0.3234 Validation Accuracy: 0.860600
Epoch 16, CIFAR-10 Batch 14:  Loss:     0.3555 Validation Accuracy: 0.852200
Epoch 16, CIFAR-10 Batch 15:  Loss:     0.3452 Validation Accuracy: 0.850200
Epoch 16, CIFAR-10 Batch 16:  Loss:     0.2873 Validation Accuracy: 0.869600
Epoch 16, CIFAR-10 Batch 17:  Loss:     0.4437 Validation Accuracy: 0.872200
Epoch 16, CIFAR-10 Batch 18:  Loss:     0.2927 Validation Accuracy: 0.854400
Epoch 16, CIFAR-10 Batch 19:  Loss:     0.2225 Validation Accuracy: 0.860800
Epoch 16, CIFAR-10 Batch 20:  Loss:     0.3912 Validation Accuracy: 0.857400
Epoch 16, CIFAR-10 Batch 21:  Loss:     0.3107 Validation Accuracy: 0.854800
Epoch 16, CIFAR-10 Batch 22:  Loss:     0.2803 Validation Accuracy: 0.850200
Epoch 16, CIFAR-10 Batch 23:  Loss:     0.3545 Validation Accuracy: 0.852800
Epoch 16, CIFAR-10 Batch 24:  Loss:     0.3563 Validation Accuracy: 0.867000
Epoch 16, CIFAR-10 Batch 25:  Loss:     0.2713 Validation Accuracy: 0.868000
Epoch 16, CIFAR-10 Batch 26:  Loss:     0.2644 Validation Accuracy: 0.877600
Epoch 16, CIFAR-10 Batch 27:  Loss:     0.2128 Validation Accuracy: 0.816000
Epoch 16, CIFAR-10 Batch 28:  Loss:     0.3570 Validation Accuracy: 0.871600
Epoch 16, CIFAR-10 Batch 29:  Loss:     0.2173 Validation Accuracy: 0.850600
Epoch 16, CIFAR-10 Batch 30:  Loss:     0.1682 Validation Accuracy: 0.858600
Epoch 16, CIFAR-10 Batch 31:  Loss:     0.2705 Validation Accuracy: 0.838800
Epoch 16, CIFAR-10 Batch 32:  Loss:     0.2363 Validation Accuracy: 0.844200
Epoch 16, CIFAR-10 Batch 33:  Loss:     0.4148 Validation Accuracy: 0.863800
Epoch 16, CIFAR-10 Batch 34:  Loss:     0.4942 Validation Accuracy: 0.863800
Epoch 16, CIFAR-10 Batch 35:  Loss:     0.4485 Validation Accuracy: 0.875800
Epoch 16, CIFAR-10 Batch 36:  Loss:     0.3413 Validation Accuracy: 0.823200
Epoch 16, CIFAR-10 Batch 37:  Loss:     0.1994 Validation Accuracy: 0.849800
Epoch 16, CIFAR-10 Batch 38:  Loss:     0.1989 Validation Accuracy: 0.853800
Epoch 16, CIFAR-10 Batch 39:  Loss:     0.1989 Validation Accuracy: 0.844600
Epoch 16, CIFAR-10 Batch 40:  Loss:     0.3461 Validation Accuracy: 0.841000
Epoch 16, CIFAR-10 Batch 41:  Loss:     0.2904 Validation Accuracy: 0.849800
Epoch 16, CIFAR-10 Batch 42:  Loss:     0.3035 Validation Accuracy: 0.862800
Epoch 16, CIFAR-10 Batch 43:  Loss:     0.3617 Validation Accuracy: 0.839200
Epoch 16, CIFAR-10 Batch 44:  Loss:     0.3431 Validation Accuracy: 0.867000
Epoch 16, CIFAR-10 Batch 45:  Loss:     0.3231 Validation Accuracy: 0.870000
Epoch 16, CIFAR-10 Batch 46:  Loss:     0.3795 Validation Accuracy: 0.865200
Epoch 16, CIFAR-10 Batch 47:  Loss:     0.2975 Validation Accuracy: 0.859400
Epoch 16, CIFAR-10 Batch 48:  Loss:     0.2816 Validation Accuracy: 0.860200
Epoch 16, CIFAR-10 Batch 49:  Loss:     0.3768 Validation Accuracy: 0.867400
Epoch 16, CIFAR-10 Batch 50:  Loss:     0.2805 Validation Accuracy: 0.863000
Epoch 17, CIFAR-10 Batch 1:  Loss:     0.2778 Validation Accuracy: 0.856000
Epoch 17, CIFAR-10 Batch 2:  Loss:     0.2279 Validation Accuracy: 0.857200
Epoch 17, CIFAR-10 Batch 3:  Loss:     0.2462 Validation Accuracy: 0.860000
Epoch 17, CIFAR-10 Batch 4:  Loss:     0.2298 Validation Accuracy: 0.858000
Epoch 17, CIFAR-10 Batch 5:  Loss:     0.3216 Validation Accuracy: 0.846000
Epoch 17, CIFAR-10 Batch 6:  Loss:     0.4038 Validation Accuracy: 0.871600
Epoch 17, CIFAR-10 Batch 7:  Loss:     0.2758 Validation Accuracy: 0.854200
Epoch 17, CIFAR-10 Batch 8:  Loss:     0.3659 Validation Accuracy: 0.870600
Epoch 17, CIFAR-10 Batch 9:  Loss:     0.3812 Validation Accuracy: 0.858800
Epoch 17, CIFAR-10 Batch 10:  Loss:     0.1588 Validation Accuracy: 0.856600
Epoch 17, CIFAR-10 Batch 11:  Loss:     0.3428 Validation Accuracy: 0.839600
Epoch 17, CIFAR-10 Batch 12:  Loss:     0.3710 Validation Accuracy: 0.857200
Epoch 17, CIFAR-10 Batch 13:  Loss:     0.3321 Validation Accuracy: 0.838400
Epoch 17, CIFAR-10 Batch 14:  Loss:     0.3012 Validation Accuracy: 0.841800
Epoch 17, CIFAR-10 Batch 15:  Loss:     0.2507 Validation Accuracy: 0.857600
Epoch 17, CIFAR-10 Batch 16:  Loss:     0.2700 Validation Accuracy: 0.854600
Epoch 17, CIFAR-10 Batch 17:  Loss:     0.5268 Validation Accuracy: 0.861600
Epoch 17, CIFAR-10 Batch 18:  Loss:     0.3709 Validation Accuracy: 0.849600
Epoch 17, CIFAR-10 Batch 19:  Loss:     0.1880 Validation Accuracy: 0.865400
Epoch 17, CIFAR-10 Batch 20:  Loss:     0.3928 Validation Accuracy: 0.858000
Epoch 17, CIFAR-10 Batch 21:  Loss:     0.3002 Validation Accuracy: 0.845400
Epoch 17, CIFAR-10 Batch 22:  Loss:     0.2694 Validation Accuracy: 0.858600
Epoch 17, CIFAR-10 Batch 23:  Loss:     0.3533 Validation Accuracy: 0.861400
Epoch 17, CIFAR-10 Batch 24:  Loss:     0.2833 Validation Accuracy: 0.867800
Epoch 17, CIFAR-10 Batch 25:  Loss:     0.3065 Validation Accuracy: 0.854400
Epoch 17, CIFAR-10 Batch 26:  Loss:     0.2620 Validation Accuracy: 0.873400
Epoch 17, CIFAR-10 Batch 27:  Loss:     0.1828 Validation Accuracy: 0.849600
Epoch 17, CIFAR-10 Batch 28:  Loss:     0.3688 Validation Accuracy: 0.866800
Epoch 17, CIFAR-10 Batch 29:  Loss:     0.2682 Validation Accuracy: 0.867200
Epoch 17, CIFAR-10 Batch 30:  Loss:     0.1651 Validation Accuracy: 0.851800
Epoch 17, CIFAR-10 Batch 31:  Loss:     0.2892 Validation Accuracy: 0.853600
Epoch 17, CIFAR-10 Batch 32:  Loss:     0.2094 Validation Accuracy: 0.866400
Epoch 17, CIFAR-10 Batch 33:  Loss:     0.5019 Validation Accuracy: 0.837200
Epoch 17, CIFAR-10 Batch 34:  Loss:     0.4898 Validation Accuracy: 0.829800
Epoch 17, CIFAR-10 Batch 35:  Loss:     0.4422 Validation Accuracy: 0.871000
Epoch 17, CIFAR-10 Batch 36:  Loss:     0.3139 Validation Accuracy: 0.847000
Epoch 17, CIFAR-10 Batch 37:  Loss:     0.2503 Validation Accuracy: 0.860600
Epoch 17, CIFAR-10 Batch 38:  Loss:     0.1950 Validation Accuracy: 0.872800
Epoch 17, CIFAR-10 Batch 39:  Loss:     0.2157 Validation Accuracy: 0.854200
Epoch 17, CIFAR-10 Batch 40:  Loss:     0.3170 Validation Accuracy: 0.842800
Epoch 17, CIFAR-10 Batch 41:  Loss:     0.2273 Validation Accuracy: 0.834800
Epoch 17, CIFAR-10 Batch 42:  Loss:     0.2480 Validation Accuracy: 0.868200
Epoch 17, CIFAR-10 Batch 43:  Loss:     0.3837 Validation Accuracy: 0.862200
Epoch 17, CIFAR-10 Batch 44:  Loss:     0.2685 Validation Accuracy: 0.872400
Epoch 17, CIFAR-10 Batch 45:  Loss:     0.2657 Validation Accuracy: 0.864600
Epoch 17, CIFAR-10 Batch 46:  Loss:     0.3773 Validation Accuracy: 0.851400
Epoch 17, CIFAR-10 Batch 47:  Loss:     0.2236 Validation Accuracy: 0.853200
Epoch 17, CIFAR-10 Batch 48:  Loss:     0.3380 Validation Accuracy: 0.854200
Epoch 17, CIFAR-10 Batch 49:  Loss:     0.2767 Validation Accuracy: 0.873000
Epoch 17, CIFAR-10 Batch 50:  Loss:     0.2575 Validation Accuracy: 0.834800
Epoch 18, CIFAR-10 Batch 1:  Loss:     0.2551 Validation Accuracy: 0.856800
Epoch 18, CIFAR-10 Batch 2:  Loss:     0.2795 Validation Accuracy: 0.861600
Epoch 18, CIFAR-10 Batch 3:  Loss:     0.2398 Validation Accuracy: 0.872000
Epoch 18, CIFAR-10 Batch 4:  Loss:     0.2068 Validation Accuracy: 0.852400
Epoch 18, CIFAR-10 Batch 5:  Loss:     0.2558 Validation Accuracy: 0.858600
Epoch 18, CIFAR-10 Batch 6:  Loss:     0.4525 Validation Accuracy: 0.872000
Epoch 18, CIFAR-10 Batch 7:  Loss:     0.2320 Validation Accuracy: 0.857200
Epoch 18, CIFAR-10 Batch 8:  Loss:     0.4307 Validation Accuracy: 0.864800
Epoch 18, CIFAR-10 Batch 9:  Loss:     0.3007 Validation Accuracy: 0.870400
Epoch 18, CIFAR-10 Batch 10:  Loss:     0.1605 Validation Accuracy: 0.861200
Epoch 18, CIFAR-10 Batch 11:  Loss:     0.2691 Validation Accuracy: 0.848600
Epoch 18, CIFAR-10 Batch 12:  Loss:     0.3393 Validation Accuracy: 0.863000
Epoch 18, CIFAR-10 Batch 13:  Loss:     0.3636 Validation Accuracy: 0.860600
Epoch 18, CIFAR-10 Batch 14:  Loss:     0.3100 Validation Accuracy: 0.852000
Epoch 18, CIFAR-10 Batch 15:  Loss:     0.2536 Validation Accuracy: 0.846600
Epoch 18, CIFAR-10 Batch 16:  Loss:     0.2357 Validation Accuracy: 0.868400
Epoch 18, CIFAR-10 Batch 17:  Loss:     0.4504 Validation Accuracy: 0.873400
Epoch 18, CIFAR-10 Batch 18:  Loss:     0.2343 Validation Accuracy: 0.861400
Epoch 18, CIFAR-10 Batch 19:  Loss:     0.2210 Validation Accuracy: 0.864000
Epoch 18, CIFAR-10 Batch 20:  Loss:     0.3470 Validation Accuracy: 0.872200
Epoch 18, CIFAR-10 Batch 21:  Loss:     0.3320 Validation Accuracy: 0.869600
Epoch 18, CIFAR-10 Batch 22:  Loss:     0.2969 Validation Accuracy: 0.866800
Epoch 18, CIFAR-10 Batch 23:  Loss:     0.3941 Validation Accuracy: 0.865000
Epoch 18, CIFAR-10 Batch 24:  Loss:     0.2905 Validation Accuracy: 0.873800
Epoch 18, CIFAR-10 Batch 25:  Loss:     0.2312 Validation Accuracy: 0.868600
Epoch 18, CIFAR-10 Batch 26:  Loss:     0.2766 Validation Accuracy: 0.849800
Epoch 18, CIFAR-10 Batch 27:  Loss:     0.1623 Validation Accuracy: 0.855000
Epoch 18, CIFAR-10 Batch 28:  Loss:     0.3482 Validation Accuracy: 0.864400
Epoch 18, CIFAR-10 Batch 29:  Loss:     0.2252 Validation Accuracy: 0.872800
Epoch 18, CIFAR-10 Batch 30:  Loss:     0.1647 Validation Accuracy: 0.869400
Epoch 18, CIFAR-10 Batch 31:  Loss:     0.2364 Validation Accuracy: 0.852600
Epoch 18, CIFAR-10 Batch 32:  Loss:     0.2047 Validation Accuracy: 0.845400
Epoch 18, CIFAR-10 Batch 33:  Loss:     0.4592 Validation Accuracy: 0.844000
Epoch 18, CIFAR-10 Batch 34:  Loss:     0.5665 Validation Accuracy: 0.849200
Epoch 18, CIFAR-10 Batch 35:  Loss:     0.3656 Validation Accuracy: 0.871000
Epoch 18, CIFAR-10 Batch 36:  Loss:     0.3534 Validation Accuracy: 0.839600
Epoch 18, CIFAR-10 Batch 37:  Loss:     0.2481 Validation Accuracy: 0.871600
Epoch 18, CIFAR-10 Batch 38:  Loss:     0.1800 Validation Accuracy: 0.871200
Epoch 18, CIFAR-10 Batch 39:  Loss:     0.1882 Validation Accuracy: 0.859000
Epoch 18, CIFAR-10 Batch 40:  Loss:     0.3001 Validation Accuracy: 0.855600
Epoch 18, CIFAR-10 Batch 41:  Loss:     0.2765 Validation Accuracy: 0.843000
Epoch 18, CIFAR-10 Batch 42:  Loss:     0.3333 Validation Accuracy: 0.870600
Epoch 18, CIFAR-10 Batch 43:  Loss:     0.3523 Validation Accuracy: 0.869400
Epoch 18, CIFAR-10 Batch 44:  Loss:     0.2911 Validation Accuracy: 0.854400
Epoch 18, CIFAR-10 Batch 45:  Loss:     0.3019 Validation Accuracy: 0.863000
Epoch 18, CIFAR-10 Batch 46:  Loss:     0.3240 Validation Accuracy: 0.867800
Epoch 18, CIFAR-10 Batch 47:  Loss:     0.2854 Validation Accuracy: 0.870000
Epoch 18, CIFAR-10 Batch 48:  Loss:     0.2880 Validation Accuracy: 0.865000
Epoch 18, CIFAR-10 Batch 49:  Loss:     0.3336 Validation Accuracy: 0.862200
Epoch 18, CIFAR-10 Batch 50:  Loss:     0.2520 Validation Accuracy: 0.869200
Epoch 19, CIFAR-10 Batch 1:  Loss:     0.2551 Validation Accuracy: 0.866600
Epoch 19, CIFAR-10 Batch 2:  Loss:     0.2737 Validation Accuracy: 0.870200
Epoch 19, CIFAR-10 Batch 3:  Loss:     0.2069 Validation Accuracy: 0.854000
Epoch 19, CIFAR-10 Batch 4:  Loss:     0.2146 Validation Accuracy: 0.854200
Epoch 19, CIFAR-10 Batch 5:  Loss:     0.2547 Validation Accuracy: 0.862200
Epoch 19, CIFAR-10 Batch 6:  Loss:     0.4141 Validation Accuracy: 0.865800
Epoch 19, CIFAR-10 Batch 7:  Loss:     0.2063 Validation Accuracy: 0.858400
Epoch 19, CIFAR-10 Batch 8:  Loss:     0.4067 Validation Accuracy: 0.859600
Epoch 19, CIFAR-10 Batch 9:  Loss:     0.2764 Validation Accuracy: 0.864400
Epoch 19, CIFAR-10 Batch 10:  Loss:     0.1678 Validation Accuracy: 0.864600
Epoch 19, CIFAR-10 Batch 11:  Loss:     0.2801 Validation Accuracy: 0.844200
Epoch 19, CIFAR-10 Batch 12:  Loss:     0.3552 Validation Accuracy: 0.854400
Epoch 19, CIFAR-10 Batch 13:  Loss:     0.2896 Validation Accuracy: 0.864800
Epoch 19, CIFAR-10 Batch 14:  Loss:     0.3732 Validation Accuracy: 0.856600
Epoch 19, CIFAR-10 Batch 15:  Loss:     0.2507 Validation Accuracy: 0.862600
Epoch 19, CIFAR-10 Batch 16:  Loss:     0.2350 Validation Accuracy: 0.837600
Epoch 19, CIFAR-10 Batch 17:  Loss:     0.4670 Validation Accuracy: 0.869000
Epoch 19, CIFAR-10 Batch 18:  Loss:     0.2192 Validation Accuracy: 0.866600
Epoch 19, CIFAR-10 Batch 19:  Loss:     0.1891 Validation Accuracy: 0.856200
Epoch 19, CIFAR-10 Batch 20:  Loss:     0.3766 Validation Accuracy: 0.854600
Epoch 19, CIFAR-10 Batch 21:  Loss:     0.3280 Validation Accuracy: 0.861000
Epoch 19, CIFAR-10 Batch 22:  Loss:     0.2534 Validation Accuracy: 0.861800
Epoch 19, CIFAR-10 Batch 23:  Loss:     0.3807 Validation Accuracy: 0.861400
Epoch 19, CIFAR-10 Batch 24:  Loss:     0.3080 Validation Accuracy: 0.872200
Epoch 19, CIFAR-10 Batch 25:  Loss:     0.3136 Validation Accuracy: 0.860400
Epoch 19, CIFAR-10 Batch 26:  Loss:     0.2293 Validation Accuracy: 0.869600
Epoch 19, CIFAR-10 Batch 27:  Loss:     0.1869 Validation Accuracy: 0.862800
Epoch 19, CIFAR-10 Batch 28:  Loss:     0.3620 Validation Accuracy: 0.852200
Epoch 19, CIFAR-10 Batch 29:  Loss:     0.2664 Validation Accuracy: 0.865400
Epoch 19, CIFAR-10 Batch 30:  Loss:     0.1726 Validation Accuracy: 0.850400
Epoch 19, CIFAR-10 Batch 31:  Loss:     0.2498 Validation Accuracy: 0.856200
Epoch 19, CIFAR-10 Batch 32:  Loss:     0.1957 Validation Accuracy: 0.848800
Epoch 19, CIFAR-10 Batch 33:  Loss:     0.4513 Validation Accuracy: 0.850400
Epoch 19, CIFAR-10 Batch 34:  Loss:     0.4255 Validation Accuracy: 0.832200
Epoch 19, CIFAR-10 Batch 35:  Loss:     0.4537 Validation Accuracy: 0.867200
Epoch 19, CIFAR-10 Batch 36:  Loss:     0.3589 Validation Accuracy: 0.838000
Epoch 19, CIFAR-10 Batch 37:  Loss:     0.2734 Validation Accuracy: 0.862000
Epoch 19, CIFAR-10 Batch 38:  Loss:     0.1648 Validation Accuracy: 0.849200
Epoch 19, CIFAR-10 Batch 39:  Loss:     0.2075 Validation Accuracy: 0.871600
Epoch 19, CIFAR-10 Batch 40:  Loss:     0.3118 Validation Accuracy: 0.857400
Epoch 19, CIFAR-10 Batch 41:  Loss:     0.2274 Validation Accuracy: 0.845000
Epoch 19, CIFAR-10 Batch 42:  Loss:     0.2196 Validation Accuracy: 0.868400
Epoch 19, CIFAR-10 Batch 43:  Loss:     0.3793 Validation Accuracy: 0.869600
Epoch 19, CIFAR-10 Batch 44:  Loss:     0.3098 Validation Accuracy: 0.845600
Epoch 19, CIFAR-10 Batch 45:  Loss:     0.2111 Validation Accuracy: 0.878400
Epoch 19, CIFAR-10 Batch 46:  Loss:     0.3209 Validation Accuracy: 0.864800
Epoch 19, CIFAR-10 Batch 47:  Loss:     0.2641 Validation Accuracy: 0.875600
Epoch 19, CIFAR-10 Batch 48:  Loss:     0.2376 Validation Accuracy: 0.850400
Epoch 19, CIFAR-10 Batch 49:  Loss:     0.3689 Validation Accuracy: 0.869200
Epoch 19, CIFAR-10 Batch 50:  Loss:     0.2974 Validation Accuracy: 0.854000
Epoch 20, CIFAR-10 Batch 1:  Loss:     0.2347 Validation Accuracy: 0.875000
Epoch 20, CIFAR-10 Batch 2:  Loss:     0.2478 Validation Accuracy: 0.862400
Epoch 20, CIFAR-10 Batch 3:  Loss:     0.1700 Validation Accuracy: 0.874200
Epoch 20, CIFAR-10 Batch 4:  Loss:     0.1993 Validation Accuracy: 0.860000
Epoch 20, CIFAR-10 Batch 5:  Loss:     0.2515 Validation Accuracy: 0.847600
Epoch 20, CIFAR-10 Batch 6:  Loss:     0.4648 Validation Accuracy: 0.871600
Epoch 20, CIFAR-10 Batch 7:  Loss:     0.2055 Validation Accuracy: 0.832600
Epoch 20, CIFAR-10 Batch 8:  Loss:     0.3786 Validation Accuracy: 0.867800
Epoch 20, CIFAR-10 Batch 9:  Loss:     0.2895 Validation Accuracy: 0.864200
Epoch 20, CIFAR-10 Batch 10:  Loss:     0.1663 Validation Accuracy: 0.861200
Epoch 20, CIFAR-10 Batch 11:  Loss:     0.2548 Validation Accuracy: 0.873400
Epoch 20, CIFAR-10 Batch 12:  Loss:     0.3045 Validation Accuracy: 0.860200
Epoch 20, CIFAR-10 Batch 13:  Loss:     0.3405 Validation Accuracy: 0.869000
Epoch 20, CIFAR-10 Batch 14:  Loss:     0.3728 Validation Accuracy: 0.857400
Epoch 20, CIFAR-10 Batch 15:  Loss:     0.2394 Validation Accuracy: 0.859600
Epoch 20, CIFAR-10 Batch 16:  Loss:     0.2211 Validation Accuracy: 0.855600
Epoch 20, CIFAR-10 Batch 17:  Loss:     0.5464 Validation Accuracy: 0.877600
Epoch 20, CIFAR-10 Batch 18:  Loss:     0.2367 Validation Accuracy: 0.845200
Epoch 20, CIFAR-10 Batch 19:  Loss:     0.1790 Validation Accuracy: 0.871800
Epoch 20, CIFAR-10 Batch 20:  Loss:     0.3621 Validation Accuracy: 0.862800
Epoch 20, CIFAR-10 Batch 21:  Loss:     0.2550 Validation Accuracy: 0.873000
Epoch 20, CIFAR-10 Batch 22:  Loss:     0.2833 Validation Accuracy: 0.869400
Epoch 20, CIFAR-10 Batch 23:  Loss:     0.3258 Validation Accuracy: 0.863800
Epoch 20, CIFAR-10 Batch 24:  Loss:     0.3409 Validation Accuracy: 0.878000
Epoch 20, CIFAR-10 Batch 25:  Loss:     0.2776 Validation Accuracy: 0.853600
Epoch 20, CIFAR-10 Batch 26:  Loss:     0.2321 Validation Accuracy: 0.872200
Epoch 20, CIFAR-10 Batch 27:  Loss:     0.2127 Validation Accuracy: 0.863800
Epoch 20, CIFAR-10 Batch 28:  Loss:     0.3639 Validation Accuracy: 0.866400
Epoch 20, CIFAR-10 Batch 29:  Loss:     0.2468 Validation Accuracy: 0.870600
Epoch 20, CIFAR-10 Batch 30:  Loss:     0.1656 Validation Accuracy: 0.862800
Epoch 20, CIFAR-10 Batch 31:  Loss:     0.2677 Validation Accuracy: 0.837600
Epoch 20, CIFAR-10 Batch 32:  Loss:     0.1941 Validation Accuracy: 0.865000
Epoch 20, CIFAR-10 Batch 33:  Loss:     0.3608 Validation Accuracy: 0.847200
Epoch 20, CIFAR-10 Batch 34:  Loss:     0.3806 Validation Accuracy: 0.856400
Epoch 20, CIFAR-10 Batch 35:  Loss:     0.3779 Validation Accuracy: 0.871600
Epoch 20, CIFAR-10 Batch 36:  Loss:     0.2956 Validation Accuracy: 0.839400
Epoch 20, CIFAR-10 Batch 37:  Loss:     0.2088 Validation Accuracy: 0.853800
Epoch 20, CIFAR-10 Batch 38:  Loss:     0.1745 Validation Accuracy: 0.868400
Epoch 20, CIFAR-10 Batch 39:  Loss:     0.2053 Validation Accuracy: 0.866200
Epoch 20, CIFAR-10 Batch 40:  Loss:     0.2876 Validation Accuracy: 0.859400
Epoch 20, CIFAR-10 Batch 41:  Loss:     0.2570 Validation Accuracy: 0.848000
Epoch 20, CIFAR-10 Batch 42:  Loss:     0.2189 Validation Accuracy: 0.868200
Epoch 20, CIFAR-10 Batch 43:  Loss:     0.3170 Validation Accuracy: 0.866600
Epoch 20, CIFAR-10 Batch 44:  Loss:     0.3801 Validation Accuracy: 0.859400
Epoch 20, CIFAR-10 Batch 45:  Loss:     0.2259 Validation Accuracy: 0.868400
Epoch 20, CIFAR-10 Batch 46:  Loss:     0.3222 Validation Accuracy: 0.873000
Epoch 20, CIFAR-10 Batch 47:  Loss:     0.2310 Validation Accuracy: 0.872600
Epoch 20, CIFAR-10 Batch 48:  Loss:     0.2598 Validation Accuracy: 0.869000
Epoch 20, CIFAR-10 Batch 49:  Loss:     0.3158 Validation Accuracy: 0.874400
Epoch 20, CIFAR-10 Batch 50:  Loss:     0.3039 Validation Accuracy: 0.876200
Epoch 21, CIFAR-10 Batch 1:  Loss:     0.2297 Validation Accuracy: 0.859200
Epoch 21, CIFAR-10 Batch 2:  Loss:     0.2482 Validation Accuracy: 0.859800
Epoch 21, CIFAR-10 Batch 3:  Loss:     0.1937 Validation Accuracy: 0.869000
Epoch 21, CIFAR-10 Batch 4:  Loss:     0.2233 Validation Accuracy: 0.857800
Epoch 21, CIFAR-10 Batch 5:  Loss:     0.2380 Validation Accuracy: 0.865400
Epoch 21, CIFAR-10 Batch 6:  Loss:     0.3942 Validation Accuracy: 0.875000
Epoch 21, CIFAR-10 Batch 7:  Loss:     0.2327 Validation Accuracy: 0.847200
Epoch 21, CIFAR-10 Batch 8:  Loss:     0.3082 Validation Accuracy: 0.876000
Epoch 21, CIFAR-10 Batch 9:  Loss:     0.2922 Validation Accuracy: 0.877600
Epoch 21, CIFAR-10 Batch 10:  Loss:     0.1699 Validation Accuracy: 0.871200
Epoch 21, CIFAR-10 Batch 11:  Loss:     0.2782 Validation Accuracy: 0.862600
Epoch 21, CIFAR-10 Batch 12:  Loss:     0.2893 Validation Accuracy: 0.828800
Epoch 21, CIFAR-10 Batch 13:  Loss:     0.2699 Validation Accuracy: 0.820600
Epoch 21, CIFAR-10 Batch 14:  Loss:     0.3345 Validation Accuracy: 0.856400
Epoch 21, CIFAR-10 Batch 15:  Loss:     0.2484 Validation Accuracy: 0.864200
Epoch 21, CIFAR-10 Batch 16:  Loss:     0.2810 Validation Accuracy: 0.864400
Epoch 21, CIFAR-10 Batch 17:  Loss:     0.4468 Validation Accuracy: 0.854200
Epoch 21, CIFAR-10 Batch 18:  Loss:     0.1821 Validation Accuracy: 0.852400
Epoch 21, CIFAR-10 Batch 19:  Loss:     0.2091 Validation Accuracy: 0.866400
Epoch 21, CIFAR-10 Batch 20:  Loss:     0.3868 Validation Accuracy: 0.864800
Epoch 21, CIFAR-10 Batch 21:  Loss:     0.2252 Validation Accuracy: 0.870400
Epoch 21, CIFAR-10 Batch 22:  Loss:     0.3346 Validation Accuracy: 0.860800
Epoch 21, CIFAR-10 Batch 23:  Loss:     0.3099 Validation Accuracy: 0.852400
Epoch 21, CIFAR-10 Batch 24:  Loss:     0.2726 Validation Accuracy: 0.870000
Epoch 21, CIFAR-10 Batch 25:  Loss:     0.2852 Validation Accuracy: 0.856200
Epoch 21, CIFAR-10 Batch 26:  Loss:     0.1924 Validation Accuracy: 0.867200
Epoch 21, CIFAR-10 Batch 27:  Loss:     0.2166 Validation Accuracy: 0.849000
Epoch 21, CIFAR-10 Batch 28:  Loss:     0.3295 Validation Accuracy: 0.865400
Epoch 21, CIFAR-10 Batch 29:  Loss:     0.2451 Validation Accuracy: 0.869400
Epoch 21, CIFAR-10 Batch 30:  Loss:     0.1703 Validation Accuracy: 0.864000
Epoch 21, CIFAR-10 Batch 31:  Loss:     0.2653 Validation Accuracy: 0.856400
Epoch 21, CIFAR-10 Batch 32:  Loss:     0.2196 Validation Accuracy: 0.865600
Epoch 21, CIFAR-10 Batch 33:  Loss:     0.4234 Validation Accuracy: 0.858800
Epoch 21, CIFAR-10 Batch 34:  Loss:     0.4154 Validation Accuracy: 0.848200
Epoch 21, CIFAR-10 Batch 35:  Loss:     0.3847 Validation Accuracy: 0.852000
Epoch 21, CIFAR-10 Batch 36:  Loss:     0.3482 Validation Accuracy: 0.853600
Epoch 21, CIFAR-10 Batch 37:  Loss:     0.2220 Validation Accuracy: 0.871200
Epoch 21, CIFAR-10 Batch 38:  Loss:     0.1769 Validation Accuracy: 0.866200
Epoch 21, CIFAR-10 Batch 39:  Loss:     0.2004 Validation Accuracy: 0.861600
Epoch 21, CIFAR-10 Batch 40:  Loss:     0.2781 Validation Accuracy: 0.836800
Epoch 21, CIFAR-10 Batch 41:  Loss:     0.2537 Validation Accuracy: 0.852200
Epoch 21, CIFAR-10 Batch 42:  Loss:     0.2160 Validation Accuracy: 0.872200
Epoch 21, CIFAR-10 Batch 43:  Loss:     0.3667 Validation Accuracy: 0.871200
Epoch 21, CIFAR-10 Batch 44:  Loss:     0.2681 Validation Accuracy: 0.863200
Epoch 21, CIFAR-10 Batch 45:  Loss:     0.2255 Validation Accuracy: 0.874800
Epoch 21, CIFAR-10 Batch 46:  Loss:     0.3289 Validation Accuracy: 0.868600
Epoch 21, CIFAR-10 Batch 47:  Loss:     0.1882 Validation Accuracy: 0.861000
Epoch 21, CIFAR-10 Batch 48:  Loss:     0.2284 Validation Accuracy: 0.863600
Epoch 21, CIFAR-10 Batch 49:  Loss:     0.3011 Validation Accuracy: 0.874600
Epoch 21, CIFAR-10 Batch 50:  Loss:     0.2701 Validation Accuracy: 0.863600
Epoch 22, CIFAR-10 Batch 1:  Loss:     0.2561 Validation Accuracy: 0.861200
Epoch 22, CIFAR-10 Batch 2:  Loss:     0.2644 Validation Accuracy: 0.871200
Epoch 22, CIFAR-10 Batch 3:  Loss:     0.1716 Validation Accuracy: 0.865800
Epoch 22, CIFAR-10 Batch 4:  Loss:     0.2008 Validation Accuracy: 0.866600
Epoch 22, CIFAR-10 Batch 5:  Loss:     0.2658 Validation Accuracy: 0.854800
Epoch 22, CIFAR-10 Batch 6:  Loss:     0.3832 Validation Accuracy: 0.866800
Epoch 22, CIFAR-10 Batch 7:  Loss:     0.1938 Validation Accuracy: 0.847000
Epoch 22, CIFAR-10 Batch 8:  Loss:     0.3362 Validation Accuracy: 0.858400
Epoch 22, CIFAR-10 Batch 9:  Loss:     0.2938 Validation Accuracy: 0.859000
Epoch 22, CIFAR-10 Batch 10:  Loss:     0.1751 Validation Accuracy: 0.851800
Epoch 22, CIFAR-10 Batch 11:  Loss:     0.2565 Validation Accuracy: 0.868000
Epoch 22, CIFAR-10 Batch 12:  Loss:     0.3136 Validation Accuracy: 0.849200
Epoch 22, CIFAR-10 Batch 13:  Loss:     0.3000 Validation Accuracy: 0.854400
Epoch 22, CIFAR-10 Batch 14:  Loss:     0.2831 Validation Accuracy: 0.861600
Epoch 22, CIFAR-10 Batch 15:  Loss:     0.2324 Validation Accuracy: 0.872200
Epoch 22, CIFAR-10 Batch 16:  Loss:     0.2179 Validation Accuracy: 0.842800
Epoch 22, CIFAR-10 Batch 17:  Loss:     0.4341 Validation Accuracy: 0.877400
Epoch 22, CIFAR-10 Batch 18:  Loss:     0.2523 Validation Accuracy: 0.861600
Epoch 22, CIFAR-10 Batch 19:  Loss:     0.2346 Validation Accuracy: 0.870000
Epoch 22, CIFAR-10 Batch 20:  Loss:     0.3523 Validation Accuracy: 0.857400
Epoch 22, CIFAR-10 Batch 21:  Loss:     0.2286 Validation Accuracy: 0.866600
Epoch 22, CIFAR-10 Batch 22:  Loss:     0.2694 Validation Accuracy: 0.855200
Epoch 22, CIFAR-10 Batch 23:  Loss:     0.3688 Validation Accuracy: 0.862000
Epoch 22, CIFAR-10 Batch 24:  Loss:     0.3590 Validation Accuracy: 0.876200
Epoch 22, CIFAR-10 Batch 25:  Loss:     0.2704 Validation Accuracy: 0.863200
Epoch 22, CIFAR-10 Batch 26:  Loss:     0.2352 Validation Accuracy: 0.866800
Epoch 22, CIFAR-10 Batch 27:  Loss:     0.2247 Validation Accuracy: 0.847000
Epoch 22, CIFAR-10 Batch 28:  Loss:     0.3145 Validation Accuracy: 0.868400
Epoch 22, CIFAR-10 Batch 29:  Loss:     0.2670 Validation Accuracy: 0.872200
Epoch 22, CIFAR-10 Batch 30:  Loss:     0.1713 Validation Accuracy: 0.859000
Epoch 22, CIFAR-10 Batch 31:  Loss:     0.2275 Validation Accuracy: 0.863600
Epoch 22, CIFAR-10 Batch 32:  Loss:     0.2063 Validation Accuracy: 0.859800
Epoch 22, CIFAR-10 Batch 33:  Loss:     0.3974 Validation Accuracy: 0.867800
Epoch 22, CIFAR-10 Batch 34:  Loss:     0.3873 Validation Accuracy: 0.854600
Epoch 22, CIFAR-10 Batch 35:  Loss:     0.3681 Validation Accuracy: 0.863400
Epoch 22, CIFAR-10 Batch 36:  Loss:     0.3148 Validation Accuracy: 0.858200
Epoch 22, CIFAR-10 Batch 37:  Loss:     0.2120 Validation Accuracy: 0.847400
Epoch 22, CIFAR-10 Batch 38:  Loss:     0.1655 Validation Accuracy: 0.848600
Epoch 22, CIFAR-10 Batch 39:  Loss:     0.1588 Validation Accuracy: 0.853000
Epoch 22, CIFAR-10 Batch 40:  Loss:     0.2601 Validation Accuracy: 0.856200
Epoch 22, CIFAR-10 Batch 41:  Loss:     0.2950 Validation Accuracy: 0.854000
Epoch 22, CIFAR-10 Batch 42:  Loss:     0.3139 Validation Accuracy: 0.880000
Epoch 22, CIFAR-10 Batch 43:  Loss:     0.4048 Validation Accuracy: 0.875000
Epoch 22, CIFAR-10 Batch 44:  Loss:     0.2693 Validation Accuracy: 0.869400
Epoch 22, CIFAR-10 Batch 45:  Loss:     0.2236 Validation Accuracy: 0.866600
Epoch 22, CIFAR-10 Batch 46:  Loss:     0.2677 Validation Accuracy: 0.865800
Epoch 22, CIFAR-10 Batch 47:  Loss:     0.2324 Validation Accuracy: 0.868000
Epoch 22, CIFAR-10 Batch 48:  Loss:     0.2888 Validation Accuracy: 0.873400
Epoch 22, CIFAR-10 Batch 49:  Loss:     0.3137 Validation Accuracy: 0.867000
Epoch 22, CIFAR-10 Batch 50:  Loss:     0.2900 Validation Accuracy: 0.867800
Epoch 23, CIFAR-10 Batch 1:  Loss:     0.2014 Validation Accuracy: 0.856800
Epoch 23, CIFAR-10 Batch 2:  Loss:     0.2440 Validation Accuracy: 0.871000
Epoch 23, CIFAR-10 Batch 3:  Loss:     0.2060 Validation Accuracy: 0.861000
Epoch 23, CIFAR-10 Batch 4:  Loss:     0.2178 Validation Accuracy: 0.866200
Epoch 23, CIFAR-10 Batch 5:  Loss:     0.2621 Validation Accuracy: 0.862600
Epoch 23, CIFAR-10 Batch 6:  Loss:     0.3091 Validation Accuracy: 0.865800
Epoch 23, CIFAR-10 Batch 7:  Loss:     0.1635 Validation Accuracy: 0.840200
Epoch 23, CIFAR-10 Batch 8:  Loss:     0.3478 Validation Accuracy: 0.881800
Epoch 23, CIFAR-10 Batch 9:  Loss:     0.3059 Validation Accuracy: 0.865200
Epoch 23, CIFAR-10 Batch 10:  Loss:     0.1503 Validation Accuracy: 0.862600
Epoch 23, CIFAR-10 Batch 11:  Loss:     0.3416 Validation Accuracy: 0.862200
Epoch 23, CIFAR-10 Batch 12:  Loss:     0.2609 Validation Accuracy: 0.859800
Epoch 23, CIFAR-10 Batch 13:  Loss:     0.2885 Validation Accuracy: 0.858400
Epoch 23, CIFAR-10 Batch 14:  Loss:     0.2669 Validation Accuracy: 0.851800
Epoch 23, CIFAR-10 Batch 15:  Loss:     0.2227 Validation Accuracy: 0.870800
Epoch 23, CIFAR-10 Batch 16:  Loss:     0.1844 Validation Accuracy: 0.862200
Epoch 23, CIFAR-10 Batch 17:  Loss:     0.4130 Validation Accuracy: 0.867000
Epoch 23, CIFAR-10 Batch 18:  Loss:     0.2451 Validation Accuracy: 0.860400
Epoch 23, CIFAR-10 Batch 19:  Loss:     0.1677 Validation Accuracy: 0.872000
Epoch 23, CIFAR-10 Batch 20:  Loss:     0.3579 Validation Accuracy: 0.872000
Epoch 23, CIFAR-10 Batch 21:  Loss:     0.3064 Validation Accuracy: 0.863600
Epoch 23, CIFAR-10 Batch 22:  Loss:     0.3023 Validation Accuracy: 0.870800
Epoch 23, CIFAR-10 Batch 23:  Loss:     0.2868 Validation Accuracy: 0.848600
Epoch 23, CIFAR-10 Batch 24:  Loss:     0.2966 Validation Accuracy: 0.876200
Epoch 23, CIFAR-10 Batch 25:  Loss:     0.2826 Validation Accuracy: 0.867000
Epoch 23, CIFAR-10 Batch 26:  Loss:     0.2249 Validation Accuracy: 0.880600
Epoch 23, CIFAR-10 Batch 27:  Loss:     0.1639 Validation Accuracy: 0.865000
Epoch 23, CIFAR-10 Batch 28:  Loss:     0.3864 Validation Accuracy: 0.868000
Epoch 23, CIFAR-10 Batch 29:  Loss:     0.1841 Validation Accuracy: 0.866200
Epoch 23, CIFAR-10 Batch 30:  Loss:     0.1543 Validation Accuracy: 0.863800
Epoch 23, CIFAR-10 Batch 31:  Loss:     0.2557 Validation Accuracy: 0.853000
Epoch 23, CIFAR-10 Batch 32:  Loss:     0.2178 Validation Accuracy: 0.874200
Epoch 23, CIFAR-10 Batch 33:  Loss:     0.4008 Validation Accuracy: 0.871800
Epoch 23, CIFAR-10 Batch 34:  Loss:     0.3761 Validation Accuracy: 0.863800
Epoch 23, CIFAR-10 Batch 35:  Loss:     0.3479 Validation Accuracy: 0.871600
Epoch 23, CIFAR-10 Batch 36:  Loss:     0.3328 Validation Accuracy: 0.860200
Epoch 23, CIFAR-10 Batch 37:  Loss:     0.1966 Validation Accuracy: 0.863800
Epoch 23, CIFAR-10 Batch 38:  Loss:     0.1833 Validation Accuracy: 0.865600
Epoch 23, CIFAR-10 Batch 39:  Loss:     0.1550 Validation Accuracy: 0.869600
Epoch 23, CIFAR-10 Batch 40:  Loss:     0.2855 Validation Accuracy: 0.857000
Epoch 23, CIFAR-10 Batch 41:  Loss:     0.2567 Validation Accuracy: 0.866800
Epoch 23, CIFAR-10 Batch 42:  Loss:     0.2458 Validation Accuracy: 0.872800
Epoch 23, CIFAR-10 Batch 43:  Loss:     0.3855 Validation Accuracy: 0.857400
Epoch 23, CIFAR-10 Batch 44:  Loss:     0.2758 Validation Accuracy: 0.864200
Epoch 23, CIFAR-10 Batch 45:  Loss:     0.2765 Validation Accuracy: 0.864800
Epoch 23, CIFAR-10 Batch 46:  Loss:     0.3206 Validation Accuracy: 0.873600
Epoch 23, CIFAR-10 Batch 47:  Loss:     0.2131 Validation Accuracy: 0.853200
Epoch 23, CIFAR-10 Batch 48:  Loss:     0.2239 Validation Accuracy: 0.877600
Epoch 23, CIFAR-10 Batch 49:  Loss:     0.3538 Validation Accuracy: 0.864800
Epoch 23, CIFAR-10 Batch 50:  Loss:     0.2686 Validation Accuracy: 0.869400
Epoch 24, CIFAR-10 Batch 1:  Loss:     0.1822 Validation Accuracy: 0.875600
Epoch 24, CIFAR-10 Batch 2:  Loss:     0.2317 Validation Accuracy: 0.845400
Epoch 24, CIFAR-10 Batch 3:  Loss:     0.1541 Validation Accuracy: 0.870000
Epoch 24, CIFAR-10 Batch 4:  Loss:     0.1868 Validation Accuracy: 0.861600
Epoch 24, CIFAR-10 Batch 5:  Loss:     0.2749 Validation Accuracy: 0.870200
Epoch 24, CIFAR-10 Batch 6:  Loss:     0.3807 Validation Accuracy: 0.874000
Epoch 24, CIFAR-10 Batch 7:  Loss:     0.2226 Validation Accuracy: 0.859600
Epoch 24, CIFAR-10 Batch 8:  Loss:     0.3115 Validation Accuracy: 0.875000
Epoch 24, CIFAR-10 Batch 9:  Loss:     0.3125 Validation Accuracy: 0.861600
Epoch 24, CIFAR-10 Batch 10:  Loss:     0.1540 Validation Accuracy: 0.875600
Epoch 24, CIFAR-10 Batch 11:  Loss:     0.2928 Validation Accuracy: 0.869400
Epoch 24, CIFAR-10 Batch 12:  Loss:     0.3135 Validation Accuracy: 0.853600
Epoch 24, CIFAR-10 Batch 13:  Loss:     0.2751 Validation Accuracy: 0.855200
Epoch 24, CIFAR-10 Batch 14:  Loss:     0.2599 Validation Accuracy: 0.869000
Epoch 24, CIFAR-10 Batch 15:  Loss:     0.1869 Validation Accuracy: 0.870200
Epoch 24, CIFAR-10 Batch 16:  Loss:     0.1983 Validation Accuracy: 0.831800
Epoch 24, CIFAR-10 Batch 17:  Loss:     0.4209 Validation Accuracy: 0.868800
Epoch 24, CIFAR-10 Batch 18:  Loss:     0.2185 Validation Accuracy: 0.860200
Epoch 24, CIFAR-10 Batch 19:  Loss:     0.1770 Validation Accuracy: 0.870200
Epoch 24, CIFAR-10 Batch 20:  Loss:     0.2752 Validation Accuracy: 0.866000
Epoch 24, CIFAR-10 Batch 21:  Loss:     0.1838 Validation Accuracy: 0.865000
Epoch 24, CIFAR-10 Batch 22:  Loss:     0.2252 Validation Accuracy: 0.862200
Epoch 24, CIFAR-10 Batch 23:  Loss:     0.3196 Validation Accuracy: 0.857000
Epoch 24, CIFAR-10 Batch 24:  Loss:     0.3164 Validation Accuracy: 0.844400
Epoch 24, CIFAR-10 Batch 25:  Loss:     0.2620 Validation Accuracy: 0.857000
Epoch 24, CIFAR-10 Batch 26:  Loss:     0.2244 Validation Accuracy: 0.869400
Epoch 24, CIFAR-10 Batch 27:  Loss:     0.1777 Validation Accuracy: 0.847000
Epoch 24, CIFAR-10 Batch 28:  Loss:     0.4309 Validation Accuracy: 0.866600
Epoch 24, CIFAR-10 Batch 29:  Loss:     0.2235 Validation Accuracy: 0.866600
Epoch 24, CIFAR-10 Batch 30:  Loss:     0.1448 Validation Accuracy: 0.873600
Epoch 24, CIFAR-10 Batch 31:  Loss:     0.1921 Validation Accuracy: 0.853800
Epoch 24, CIFAR-10 Batch 32:  Loss:     0.2173 Validation Accuracy: 0.868800
Epoch 24, CIFAR-10 Batch 33:  Loss:     0.3767 Validation Accuracy: 0.863400
Epoch 24, CIFAR-10 Batch 34:  Loss:     0.3666 Validation Accuracy: 0.861000
Epoch 24, CIFAR-10 Batch 35:  Loss:     0.3903 Validation Accuracy: 0.866200
Epoch 24, CIFAR-10 Batch 36:  Loss:     0.2915 Validation Accuracy: 0.867600
Epoch 24, CIFAR-10 Batch 37:  Loss:     0.2211 Validation Accuracy: 0.864800
Epoch 24, CIFAR-10 Batch 38:  Loss:     0.2146 Validation Accuracy: 0.858600
Epoch 24, CIFAR-10 Batch 39:  Loss:     0.1489 Validation Accuracy: 0.873000
Epoch 24, CIFAR-10 Batch 40:  Loss:     0.2312 Validation Accuracy: 0.868800
Epoch 24, CIFAR-10 Batch 41:  Loss:     0.2340 Validation Accuracy: 0.865800
Epoch 24, CIFAR-10 Batch 42:  Loss:     0.2373 Validation Accuracy: 0.853800
Epoch 24, CIFAR-10 Batch 43:  Loss:     0.3406 Validation Accuracy: 0.872600
Epoch 24, CIFAR-10 Batch 44:  Loss:     0.2625 Validation Accuracy: 0.859400
Epoch 24, CIFAR-10 Batch 45:  Loss:     0.1880 Validation Accuracy: 0.874600
Epoch 24, CIFAR-10 Batch 46:  Loss:     0.3331 Validation Accuracy: 0.863800
Epoch 24, CIFAR-10 Batch 47:  Loss:     0.1709 Validation Accuracy: 0.865800
Epoch 24, CIFAR-10 Batch 48:  Loss:     0.2607 Validation Accuracy: 0.871800
Epoch 24, CIFAR-10 Batch 49:  Loss:     0.3169 Validation Accuracy: 0.870800
Epoch 24, CIFAR-10 Batch 50:  Loss:     0.1992 Validation Accuracy: 0.863600
Epoch 25, CIFAR-10 Batch 1:  Loss:     0.1721 Validation Accuracy: 0.876200
Epoch 25, CIFAR-10 Batch 2:  Loss:     0.1913 Validation Accuracy: 0.863200
Epoch 25, CIFAR-10 Batch 3:  Loss:     0.1990 Validation Accuracy: 0.862400
Epoch 25, CIFAR-10 Batch 4:  Loss:     0.2007 Validation Accuracy: 0.862800
Epoch 25, CIFAR-10 Batch 5:  Loss:     0.2607 Validation Accuracy: 0.878800
Epoch 25, CIFAR-10 Batch 6:  Loss:     0.3822 Validation Accuracy: 0.853200
Epoch 25, CIFAR-10 Batch 7:  Loss:     0.1570 Validation Accuracy: 0.848600
Epoch 25, CIFAR-10 Batch 8:  Loss:     0.3452 Validation Accuracy: 0.869000
Epoch 25, CIFAR-10 Batch 9:  Loss:     0.2718 Validation Accuracy: 0.879200
Epoch 25, CIFAR-10 Batch 10:  Loss:     0.1510 Validation Accuracy: 0.864800
Epoch 25, CIFAR-10 Batch 11:  Loss:     0.3189 Validation Accuracy: 0.870400
Epoch 25, CIFAR-10 Batch 12:  Loss:     0.2476 Validation Accuracy: 0.868400
Epoch 25, CIFAR-10 Batch 13:  Loss:     0.3093 Validation Accuracy: 0.863400
Epoch 25, CIFAR-10 Batch 14:  Loss:     0.2292 Validation Accuracy: 0.877400
Epoch 25, CIFAR-10 Batch 15:  Loss:     0.1874 Validation Accuracy: 0.864400
Epoch 25, CIFAR-10 Batch 16:  Loss:     0.1859 Validation Accuracy: 0.856200
Epoch 25, CIFAR-10 Batch 17:  Loss:     0.3699 Validation Accuracy: 0.856800
Epoch 25, CIFAR-10 Batch 18:  Loss:     0.1752 Validation Accuracy: 0.858400
Epoch 25, CIFAR-10 Batch 19:  Loss:     0.2000 Validation Accuracy: 0.864600
Epoch 25, CIFAR-10 Batch 20:  Loss:     0.3513 Validation Accuracy: 0.877000
Epoch 25, CIFAR-10 Batch 21:  Loss:     0.2233 Validation Accuracy: 0.875800
Epoch 25, CIFAR-10 Batch 22:  Loss:     0.2049 Validation Accuracy: 0.875400
Epoch 25, CIFAR-10 Batch 23:  Loss:     0.2859 Validation Accuracy: 0.870000
Epoch 25, CIFAR-10 Batch 24:  Loss:     0.2352 Validation Accuracy: 0.862800
Epoch 25, CIFAR-10 Batch 25:  Loss:     0.2309 Validation Accuracy: 0.858000
Epoch 25, CIFAR-10 Batch 26:  Loss:     0.2076 Validation Accuracy: 0.869800
Epoch 25, CIFAR-10 Batch 27:  Loss:     0.1781 Validation Accuracy: 0.868400
Epoch 25, CIFAR-10 Batch 28:  Loss:     0.3703 Validation Accuracy: 0.862400
Epoch 25, CIFAR-10 Batch 29:  Loss:     0.2373 Validation Accuracy: 0.877800
Epoch 25, CIFAR-10 Batch 30:  Loss:     0.1500 Validation Accuracy: 0.863000
Epoch 25, CIFAR-10 Batch 31:  Loss:     0.2098 Validation Accuracy: 0.868800
Epoch 25, CIFAR-10 Batch 32:  Loss:     0.1966 Validation Accuracy: 0.866400
Epoch 25, CIFAR-10 Batch 33:  Loss:     0.4105 Validation Accuracy: 0.844800
Epoch 25, CIFAR-10 Batch 34:  Loss:     0.3491 Validation Accuracy: 0.849000
Epoch 25, CIFAR-10 Batch 35:  Loss:     0.4086 Validation Accuracy: 0.875000
Epoch 25, CIFAR-10 Batch 36:  Loss:     0.3278 Validation Accuracy: 0.854000
Epoch 25, CIFAR-10 Batch 37:  Loss:     0.2237 Validation Accuracy: 0.857200
Epoch 25, CIFAR-10 Batch 38:  Loss:     0.1610 Validation Accuracy: 0.874600
Epoch 25, CIFAR-10 Batch 39:  Loss:     0.1598 Validation Accuracy: 0.866200
Epoch 25, CIFAR-10 Batch 40:  Loss:     0.2445 Validation Accuracy: 0.859400
Epoch 25, CIFAR-10 Batch 41:  Loss:     0.2888 Validation Accuracy: 0.862600
Epoch 25, CIFAR-10 Batch 42:  Loss:     0.2275 Validation Accuracy: 0.866800
Epoch 25, CIFAR-10 Batch 43:  Loss:     0.3471 Validation Accuracy: 0.872200
Epoch 25, CIFAR-10 Batch 44:  Loss:     0.2803 Validation Accuracy: 0.865600
Epoch 25, CIFAR-10 Batch 45:  Loss:     0.2431 Validation Accuracy: 0.862400
Epoch 25, CIFAR-10 Batch 46:  Loss:     0.3248 Validation Accuracy: 0.870600
Epoch 25, CIFAR-10 Batch 47:  Loss:     0.2287 Validation Accuracy: 0.863000
Epoch 25, CIFAR-10 Batch 48:  Loss:     0.2283 Validation Accuracy: 0.873200
Epoch 25, CIFAR-10 Batch 49:  Loss:     0.3234 Validation Accuracy: 0.870200
Epoch 25, CIFAR-10 Batch 50:  Loss:     0.2278 Validation Accuracy: 0.865200
Epoch 26, CIFAR-10 Batch 1:  Loss:     0.2489 Validation Accuracy: 0.862600
Epoch 26, CIFAR-10 Batch 2:  Loss:     0.2194 Validation Accuracy: 0.850200
Epoch 26, CIFAR-10 Batch 3:  Loss:     0.1900 Validation Accuracy: 0.877400
Epoch 26, CIFAR-10 Batch 4:  Loss:     0.2006 Validation Accuracy: 0.867000
Epoch 26, CIFAR-10 Batch 5:  Loss:     0.2445 Validation Accuracy: 0.865400
Epoch 26, CIFAR-10 Batch 6:  Loss:     0.4398 Validation Accuracy: 0.873000
Epoch 26, CIFAR-10 Batch 7:  Loss:     0.2067 Validation Accuracy: 0.854600
Epoch 26, CIFAR-10 Batch 8:  Loss:     0.3514 Validation Accuracy: 0.873800
Epoch 26, CIFAR-10 Batch 9:  Loss:     0.2620 Validation Accuracy: 0.860400
Epoch 26, CIFAR-10 Batch 10:  Loss:     0.1936 Validation Accuracy: 0.875200
Epoch 26, CIFAR-10 Batch 11:  Loss:     0.2669 Validation Accuracy: 0.845200
Epoch 26, CIFAR-10 Batch 12:  Loss:     0.2871 Validation Accuracy: 0.855800
Epoch 26, CIFAR-10 Batch 13:  Loss:     0.2716 Validation Accuracy: 0.873800
Epoch 26, CIFAR-10 Batch 14:  Loss:     0.3041 Validation Accuracy: 0.870400
Epoch 26, CIFAR-10 Batch 15:  Loss:     0.2516 Validation Accuracy: 0.852000
Epoch 26, CIFAR-10 Batch 16:  Loss:     0.2396 Validation Accuracy: 0.868600
Epoch 26, CIFAR-10 Batch 17:  Loss:     0.3671 Validation Accuracy: 0.869600
Epoch 26, CIFAR-10 Batch 18:  Loss:     0.2032 Validation Accuracy: 0.868400
Epoch 26, CIFAR-10 Batch 19:  Loss:     0.1999 Validation Accuracy: 0.873400
Epoch 26, CIFAR-10 Batch 20:  Loss:     0.3249 Validation Accuracy: 0.866800
Epoch 26, CIFAR-10 Batch 21:  Loss:     0.2124 Validation Accuracy: 0.873600
Epoch 26, CIFAR-10 Batch 22:  Loss:     0.2279 Validation Accuracy: 0.851200
Epoch 26, CIFAR-10 Batch 23:  Loss:     0.2927 Validation Accuracy: 0.852800
Epoch 26, CIFAR-10 Batch 24:  Loss:     0.2505 Validation Accuracy: 0.879800
Epoch 26, CIFAR-10 Batch 25:  Loss:     0.2620 Validation Accuracy: 0.856200
Epoch 26, CIFAR-10 Batch 26:  Loss:     0.2329 Validation Accuracy: 0.867800
Epoch 26, CIFAR-10 Batch 27:  Loss:     0.1702 Validation Accuracy: 0.866200
Epoch 26, CIFAR-10 Batch 28:  Loss:     0.3569 Validation Accuracy: 0.870600
Epoch 26, CIFAR-10 Batch 29:  Loss:     0.2662 Validation Accuracy: 0.861200
Epoch 26, CIFAR-10 Batch 30:  Loss:     0.1680 Validation Accuracy: 0.863000
Epoch 26, CIFAR-10 Batch 31:  Loss:     0.2182 Validation Accuracy: 0.857200
Epoch 26, CIFAR-10 Batch 32:  Loss:     0.2134 Validation Accuracy: 0.872400
Epoch 26, CIFAR-10 Batch 33:  Loss:     0.4222 Validation Accuracy: 0.863600
Epoch 26, CIFAR-10 Batch 34:  Loss:     0.3878 Validation Accuracy: 0.866200
Epoch 26, CIFAR-10 Batch 35:  Loss:     0.3056 Validation Accuracy: 0.865800
Epoch 26, CIFAR-10 Batch 36:  Loss:     0.3251 Validation Accuracy: 0.868400
Epoch 26, CIFAR-10 Batch 37:  Loss:     0.2292 Validation Accuracy: 0.876600
Epoch 26, CIFAR-10 Batch 38:  Loss:     0.1650 Validation Accuracy: 0.873800
Epoch 26, CIFAR-10 Batch 39:  Loss:     0.1616 Validation Accuracy: 0.868200
Epoch 26, CIFAR-10 Batch 40:  Loss:     0.2446 Validation Accuracy: 0.865400
Epoch 26, CIFAR-10 Batch 41:  Loss:     0.2461 Validation Accuracy: 0.874200
Epoch 26, CIFAR-10 Batch 42:  Loss:     0.2324 Validation Accuracy: 0.867600
Epoch 26, CIFAR-10 Batch 43:  Loss:     0.3628 Validation Accuracy: 0.865200
Epoch 26, CIFAR-10 Batch 44:  Loss:     0.2925 Validation Accuracy: 0.859800
Epoch 26, CIFAR-10 Batch 45:  Loss:     0.2280 Validation Accuracy: 0.866200
Epoch 26, CIFAR-10 Batch 46:  Loss:     0.3135 Validation Accuracy: 0.871800
Epoch 26, CIFAR-10 Batch 47:  Loss:     0.2361 Validation Accuracy: 0.869200
Epoch 26, CIFAR-10 Batch 48:  Loss:     0.2433 Validation Accuracy: 0.869200
Epoch 26, CIFAR-10 Batch 49:  Loss:     0.2623 Validation Accuracy: 0.864400
Epoch 26, CIFAR-10 Batch 50:  Loss:     0.2725 Validation Accuracy: 0.876000
Epoch 27, CIFAR-10 Batch 1:  Loss:     0.2161 Validation Accuracy: 0.856400
Epoch 27, CIFAR-10 Batch 2:  Loss:     0.2946 Validation Accuracy: 0.874400
Epoch 27, CIFAR-10 Batch 3:  Loss:     0.1749 Validation Accuracy: 0.869200
Epoch 27, CIFAR-10 Batch 4:  Loss:     0.1756 Validation Accuracy: 0.872200
Epoch 27, CIFAR-10 Batch 5:  Loss:     0.2044 Validation Accuracy: 0.865200
Epoch 27, CIFAR-10 Batch 6:  Loss:     0.4036 Validation Accuracy: 0.867800
Epoch 27, CIFAR-10 Batch 7:  Loss:     0.1676 Validation Accuracy: 0.865800
Epoch 27, CIFAR-10 Batch 8:  Loss:     0.3454 Validation Accuracy: 0.870200
Epoch 27, CIFAR-10 Batch 9:  Loss:     0.2378 Validation Accuracy: 0.873600
Epoch 27, CIFAR-10 Batch 10:  Loss:     0.1706 Validation Accuracy: 0.876200
Epoch 27, CIFAR-10 Batch 11:  Loss:     0.2712 Validation Accuracy: 0.870000
Epoch 27, CIFAR-10 Batch 12:  Loss:     0.3071 Validation Accuracy: 0.869800
Epoch 27, CIFAR-10 Batch 13:  Loss:     0.2692 Validation Accuracy: 0.876600
Epoch 27, CIFAR-10 Batch 14:  Loss:     0.3143 Validation Accuracy: 0.865800
Epoch 27, CIFAR-10 Batch 15:  Loss:     0.1761 Validation Accuracy: 0.838200
Epoch 27, CIFAR-10 Batch 16:  Loss:     0.2075 Validation Accuracy: 0.860400
Epoch 27, CIFAR-10 Batch 17:  Loss:     0.3166 Validation Accuracy: 0.864400
Epoch 27, CIFAR-10 Batch 18:  Loss:     0.1819 Validation Accuracy: 0.870200
Epoch 27, CIFAR-10 Batch 19:  Loss:     0.2013 Validation Accuracy: 0.868200
Epoch 27, CIFAR-10 Batch 20:  Loss:     0.3243 Validation Accuracy: 0.879800
Epoch 27, CIFAR-10 Batch 21:  Loss:     0.1768 Validation Accuracy: 0.857000
Epoch 27, CIFAR-10 Batch 22:  Loss:     0.2800 Validation Accuracy: 0.869800
Epoch 27, CIFAR-10 Batch 23:  Loss:     0.2986 Validation Accuracy: 0.860800
Epoch 27, CIFAR-10 Batch 24:  Loss:     0.2470 Validation Accuracy: 0.875200
Epoch 27, CIFAR-10 Batch 25:  Loss:     0.2476 Validation Accuracy: 0.861600
Epoch 27, CIFAR-10 Batch 26:  Loss:     0.2043 Validation Accuracy: 0.880400
Epoch 27, CIFAR-10 Batch 27:  Loss:     0.1536 Validation Accuracy: 0.872000
Epoch 27, CIFAR-10 Batch 28:  Loss:     0.3277 Validation Accuracy: 0.871000
Epoch 27, CIFAR-10 Batch 29:  Loss:     0.2472 Validation Accuracy: 0.879000
Epoch 27, CIFAR-10 Batch 30:  Loss:     0.1719 Validation Accuracy: 0.877200
Epoch 27, CIFAR-10 Batch 31:  Loss:     0.2005 Validation Accuracy: 0.859400
Epoch 27, CIFAR-10 Batch 32:  Loss:     0.1946 Validation Accuracy: 0.881000
Epoch 27, CIFAR-10 Batch 33:  Loss:     0.3947 Validation Accuracy: 0.863400
Epoch 27, CIFAR-10 Batch 34:  Loss:     0.4406 Validation Accuracy: 0.842400
Epoch 27, CIFAR-10 Batch 35:  Loss:     0.3231 Validation Accuracy: 0.873000
Epoch 27, CIFAR-10 Batch 36:  Loss:     0.2829 Validation Accuracy: 0.845600
Epoch 27, CIFAR-10 Batch 37:  Loss:     0.2181 Validation Accuracy: 0.866800
Epoch 27, CIFAR-10 Batch 38:  Loss:     0.1545 Validation Accuracy: 0.857000
Epoch 27, CIFAR-10 Batch 39:  Loss:     0.1657 Validation Accuracy: 0.869800
Epoch 27, CIFAR-10 Batch 40:  Loss:     0.2781 Validation Accuracy: 0.878800
Epoch 27, CIFAR-10 Batch 41:  Loss:     0.2511 Validation Accuracy: 0.851000
Epoch 27, CIFAR-10 Batch 42:  Loss:     0.2291 Validation Accuracy: 0.863600
Epoch 27, CIFAR-10 Batch 43:  Loss:     0.3396 Validation Accuracy: 0.871600
Epoch 27, CIFAR-10 Batch 44:  Loss:     0.2328 Validation Accuracy: 0.861800
Epoch 27, CIFAR-10 Batch 45:  Loss:     0.2062 Validation Accuracy: 0.856800
Epoch 27, CIFAR-10 Batch 46:  Loss:     0.2596 Validation Accuracy: 0.866200
Epoch 27, CIFAR-10 Batch 47:  Loss:     0.2348 Validation Accuracy: 0.864000
Epoch 27, CIFAR-10 Batch 48:  Loss:     0.2552 Validation Accuracy: 0.859600
Epoch 27, CIFAR-10 Batch 49:  Loss:     0.2985 Validation Accuracy: 0.867800
Epoch 27, CIFAR-10 Batch 50:  Loss:     0.2497 Validation Accuracy: 0.877800
Epoch 28, CIFAR-10 Batch 1:  Loss:     0.1854 Validation Accuracy: 0.868200
Epoch 28, CIFAR-10 Batch 2:  Loss:     0.2440 Validation Accuracy: 0.861000
Epoch 28, CIFAR-10 Batch 3:  Loss:     0.1712 Validation Accuracy: 0.864800
Epoch 28, CIFAR-10 Batch 4:  Loss:     0.1593 Validation Accuracy: 0.865200
Epoch 28, CIFAR-10 Batch 5:  Loss:     0.2032 Validation Accuracy: 0.859800
Epoch 28, CIFAR-10 Batch 6:  Loss:     0.3990 Validation Accuracy: 0.874000
Epoch 28, CIFAR-10 Batch 7:  Loss:     0.1770 Validation Accuracy: 0.852600
Epoch 28, CIFAR-10 Batch 8:  Loss:     0.3332 Validation Accuracy: 0.870400
Epoch 28, CIFAR-10 Batch 9:  Loss:     0.2392 Validation Accuracy: 0.865600
Epoch 28, CIFAR-10 Batch 10:  Loss:     0.1549 Validation Accuracy: 0.872200
Epoch 28, CIFAR-10 Batch 11:  Loss:     0.2396 Validation Accuracy: 0.868000
Epoch 28, CIFAR-10 Batch 12:  Loss:     0.3307 Validation Accuracy: 0.863800
Epoch 28, CIFAR-10 Batch 13:  Loss:     0.2341 Validation Accuracy: 0.874000
Epoch 28, CIFAR-10 Batch 14:  Loss:     0.2852 Validation Accuracy: 0.818400
Epoch 28, CIFAR-10 Batch 15:  Loss:     0.1834 Validation Accuracy: 0.872000
Epoch 28, CIFAR-10 Batch 16:  Loss:     0.2005 Validation Accuracy: 0.864800
Epoch 28, CIFAR-10 Batch 17:  Loss:     0.3053 Validation Accuracy: 0.862800
Epoch 28, CIFAR-10 Batch 18:  Loss:     0.2039 Validation Accuracy: 0.862000
Epoch 28, CIFAR-10 Batch 19:  Loss:     0.1747 Validation Accuracy: 0.867400
Epoch 28, CIFAR-10 Batch 20:  Loss:     0.3183 Validation Accuracy: 0.879000
Epoch 28, CIFAR-10 Batch 21:  Loss:     0.2640 Validation Accuracy: 0.868200
Epoch 28, CIFAR-10 Batch 22:  Loss:     0.2141 Validation Accuracy: 0.862800
Epoch 28, CIFAR-10 Batch 23:  Loss:     0.2652 Validation Accuracy: 0.873400
Epoch 28, CIFAR-10 Batch 24:  Loss:     0.2285 Validation Accuracy: 0.874600
Epoch 28, CIFAR-10 Batch 25:  Loss:     0.2909 Validation Accuracy: 0.875400
Epoch 28, CIFAR-10 Batch 26:  Loss:     0.2069 Validation Accuracy: 0.869800
Epoch 28, CIFAR-10 Batch 27:  Loss:     0.2055 Validation Accuracy: 0.864000
Epoch 28, CIFAR-10 Batch 28:  Loss:     0.2780 Validation Accuracy: 0.866800
Epoch 28, CIFAR-10 Batch 29:  Loss:     0.1905 Validation Accuracy: 0.869800
Epoch 28, CIFAR-10 Batch 30:  Loss:     0.1775 Validation Accuracy: 0.871200
Epoch 28, CIFAR-10 Batch 31:  Loss:     0.1987 Validation Accuracy: 0.867000
Epoch 28, CIFAR-10 Batch 32:  Loss:     0.1840 Validation Accuracy: 0.862800
Epoch 28, CIFAR-10 Batch 33:  Loss:     0.3378 Validation Accuracy: 0.859400
Epoch 28, CIFAR-10 Batch 34:  Loss:     0.3926 Validation Accuracy: 0.863400
Epoch 28, CIFAR-10 Batch 35:  Loss:     0.2756 Validation Accuracy: 0.868800
Epoch 28, CIFAR-10 Batch 36:  Loss:     0.3185 Validation Accuracy: 0.856000
Epoch 28, CIFAR-10 Batch 37:  Loss:     0.1653 Validation Accuracy: 0.878000
Epoch 28, CIFAR-10 Batch 38:  Loss:     0.1633 Validation Accuracy: 0.866000
Epoch 28, CIFAR-10 Batch 39:  Loss:     0.2027 Validation Accuracy: 0.862600
Epoch 28, CIFAR-10 Batch 40:  Loss:     0.2217 Validation Accuracy: 0.865400
Epoch 28, CIFAR-10 Batch 41:  Loss:     0.2056 Validation Accuracy: 0.858800
Epoch 28, CIFAR-10 Batch 42:  Loss:     0.2371 Validation Accuracy: 0.854200
Epoch 28, CIFAR-10 Batch 43:  Loss:     0.3120 Validation Accuracy: 0.871000
Epoch 28, CIFAR-10 Batch 44:  Loss:     0.2619 Validation Accuracy: 0.860400
Epoch 28, CIFAR-10 Batch 45:  Loss:     0.1762 Validation Accuracy: 0.867400
Epoch 28, CIFAR-10 Batch 46:  Loss:     0.3162 Validation Accuracy: 0.856000
Epoch 28, CIFAR-10 Batch 47:  Loss:     0.2271 Validation Accuracy: 0.869200
Epoch 28, CIFAR-10 Batch 48:  Loss:     0.3159 Validation Accuracy: 0.862000
Epoch 28, CIFAR-10 Batch 49:  Loss:     0.2801 Validation Accuracy: 0.853200
Epoch 28, CIFAR-10 Batch 50:  Loss:     0.1942 Validation Accuracy: 0.875600
Epoch 29, CIFAR-10 Batch 1:  Loss:     0.1794 Validation Accuracy: 0.846000
Epoch 29, CIFAR-10 Batch 2:  Loss:     0.1747 Validation Accuracy: 0.878200
Epoch 29, CIFAR-10 Batch 3:  Loss:     0.1870 Validation Accuracy: 0.880200
Epoch 29, CIFAR-10 Batch 4:  Loss:     0.1968 Validation Accuracy: 0.875200
Epoch 29, CIFAR-10 Batch 5:  Loss:     0.2003 Validation Accuracy: 0.869200
Epoch 29, CIFAR-10 Batch 6:  Loss:     0.4272 Validation Accuracy: 0.873600
Epoch 29, CIFAR-10 Batch 7:  Loss:     0.2283 Validation Accuracy: 0.867600
Epoch 29, CIFAR-10 Batch 8:  Loss:     0.3279 Validation Accuracy: 0.881200
Epoch 29, CIFAR-10 Batch 9:  Loss:     0.2476 Validation Accuracy: 0.876400
Epoch 29, CIFAR-10 Batch 10:  Loss:     0.1673 Validation Accuracy: 0.864600
Epoch 29, CIFAR-10 Batch 11:  Loss:     0.2660 Validation Accuracy: 0.865600
Epoch 29, CIFAR-10 Batch 12:  Loss:     0.2609 Validation Accuracy: 0.855000
Epoch 29, CIFAR-10 Batch 13:  Loss:     0.2742 Validation Accuracy: 0.860800
Epoch 29, CIFAR-10 Batch 14:  Loss:     0.2178 Validation Accuracy: 0.872000
Epoch 29, CIFAR-10 Batch 15:  Loss:     0.1969 Validation Accuracy: 0.878400
Epoch 29, CIFAR-10 Batch 16:  Loss:     0.1872 Validation Accuracy: 0.857800
Epoch 29, CIFAR-10 Batch 17:  Loss:     0.2882 Validation Accuracy: 0.854800
Epoch 29, CIFAR-10 Batch 18:  Loss:     0.2127 Validation Accuracy: 0.864200
Epoch 29, CIFAR-10 Batch 19:  Loss:     0.2275 Validation Accuracy: 0.847400
Epoch 29, CIFAR-10 Batch 20:  Loss:     0.3914 Validation Accuracy: 0.870600
Epoch 29, CIFAR-10 Batch 21:  Loss:     0.1947 Validation Accuracy: 0.879600
Epoch 29, CIFAR-10 Batch 22:  Loss:     0.2432 Validation Accuracy: 0.874600
Epoch 29, CIFAR-10 Batch 23:  Loss:     0.3108 Validation Accuracy: 0.867000
Epoch 29, CIFAR-10 Batch 24:  Loss:     0.2489 Validation Accuracy: 0.883200
Epoch 29, CIFAR-10 Batch 25:  Loss:     0.2617 Validation Accuracy: 0.868800
Epoch 29, CIFAR-10 Batch 26:  Loss:     0.2017 Validation Accuracy: 0.877600
Epoch 29, CIFAR-10 Batch 27:  Loss:     0.1619 Validation Accuracy: 0.859400
Epoch 29, CIFAR-10 Batch 28:  Loss:     0.3152 Validation Accuracy: 0.869400
Epoch 29, CIFAR-10 Batch 29:  Loss:     0.1982 Validation Accuracy: 0.866400
Epoch 29, CIFAR-10 Batch 30:  Loss:     0.1795 Validation Accuracy: 0.881200
Epoch 29, CIFAR-10 Batch 31:  Loss:     0.2180 Validation Accuracy: 0.870200
Epoch 29, CIFAR-10 Batch 32:  Loss:     0.1655 Validation Accuracy: 0.852800
Epoch 29, CIFAR-10 Batch 33:  Loss:     0.3296 Validation Accuracy: 0.860600
Epoch 29, CIFAR-10 Batch 34:  Loss:     0.3876 Validation Accuracy: 0.863400
Epoch 29, CIFAR-10 Batch 35:  Loss:     0.2808 Validation Accuracy: 0.879600
Epoch 29, CIFAR-10 Batch 36:  Loss:     0.2788 Validation Accuracy: 0.843000
Epoch 29, CIFAR-10 Batch 37:  Loss:     0.2127 Validation Accuracy: 0.868200
Epoch 29, CIFAR-10 Batch 38:  Loss:     0.1738 Validation Accuracy: 0.869200
Epoch 29, CIFAR-10 Batch 39:  Loss:     0.1763 Validation Accuracy: 0.870600
Epoch 29, CIFAR-10 Batch 40:  Loss:     0.2554 Validation Accuracy: 0.857000
Epoch 29, CIFAR-10 Batch 41:  Loss:     0.2178 Validation Accuracy: 0.873200
Epoch 29, CIFAR-10 Batch 42:  Loss:     0.2586 Validation Accuracy: 0.864200
Epoch 29, CIFAR-10 Batch 43:  Loss:     0.3077 Validation Accuracy: 0.865600
Epoch 29, CIFAR-10 Batch 44:  Loss:     0.2836 Validation Accuracy: 0.857800
Epoch 29, CIFAR-10 Batch 45:  Loss:     0.2269 Validation Accuracy: 0.865400
Epoch 29, CIFAR-10 Batch 46:  Loss:     0.3377 Validation Accuracy: 0.874600
Epoch 29, CIFAR-10 Batch 47:  Loss:     0.1700 Validation Accuracy: 0.873800
Epoch 29, CIFAR-10 Batch 48:  Loss:     0.2467 Validation Accuracy: 0.876000
Epoch 29, CIFAR-10 Batch 49:  Loss:     0.2879 Validation Accuracy: 0.862000
Epoch 29, CIFAR-10 Batch 50:  Loss:     0.1951 Validation Accuracy: 0.881200
Epoch 30, CIFAR-10 Batch 1:  Loss:     0.1804 Validation Accuracy: 0.875400
Epoch 30, CIFAR-10 Batch 2:  Loss:     0.1908 Validation Accuracy: 0.879600
Epoch 30, CIFAR-10 Batch 3:  Loss:     0.1755 Validation Accuracy: 0.881600
Epoch 30, CIFAR-10 Batch 4:  Loss:     0.1719 Validation Accuracy: 0.864400
Epoch 30, CIFAR-10 Batch 5:  Loss:     0.2248 Validation Accuracy: 0.878200
Epoch 30, CIFAR-10 Batch 6:  Loss:     0.3569 Validation Accuracy: 0.864800
Epoch 30, CIFAR-10 Batch 7:  Loss:     0.1738 Validation Accuracy: 0.864800
Epoch 30, CIFAR-10 Batch 8:  Loss:     0.2629 Validation Accuracy: 0.871200
Epoch 30, CIFAR-10 Batch 9:  Loss:     0.1964 Validation Accuracy: 0.866000
Epoch 30, CIFAR-10 Batch 10:  Loss:     0.1432 Validation Accuracy: 0.861400
Epoch 30, CIFAR-10 Batch 11:  Loss:     0.2197 Validation Accuracy: 0.875200
Epoch 30, CIFAR-10 Batch 12:  Loss:     0.2319 Validation Accuracy: 0.854400
Epoch 30, CIFAR-10 Batch 13:  Loss:     0.2449 Validation Accuracy: 0.871600
Epoch 30, CIFAR-10 Batch 14:  Loss:     0.2116 Validation Accuracy: 0.850000
Epoch 30, CIFAR-10 Batch 15:  Loss:     0.2129 Validation Accuracy: 0.868200
Epoch 30, CIFAR-10 Batch 16:  Loss:     0.1968 Validation Accuracy: 0.858800
Epoch 30, CIFAR-10 Batch 17:  Loss:     0.2652 Validation Accuracy: 0.873400
Epoch 30, CIFAR-10 Batch 18:  Loss:     0.1697 Validation Accuracy: 0.868600
Epoch 30, CIFAR-10 Batch 19:  Loss:     0.1683 Validation Accuracy: 0.869400
Epoch 30, CIFAR-10 Batch 20:  Loss:     0.2920 Validation Accuracy: 0.862200
Epoch 30, CIFAR-10 Batch 21:  Loss:     0.2366 Validation Accuracy: 0.865600
Epoch 30, CIFAR-10 Batch 22:  Loss:     0.2232 Validation Accuracy: 0.840600
Epoch 30, CIFAR-10 Batch 23:  Loss:     0.2209 Validation Accuracy: 0.863400
Epoch 30, CIFAR-10 Batch 24:  Loss:     0.2008 Validation Accuracy: 0.867800
Epoch 30, CIFAR-10 Batch 25:  Loss:     0.3164 Validation Accuracy: 0.839600
Epoch 30, CIFAR-10 Batch 26:  Loss:     0.2351 Validation Accuracy: 0.877400
Epoch 30, CIFAR-10 Batch 27:  Loss:     0.1845 Validation Accuracy: 0.859400
Epoch 30, CIFAR-10 Batch 28:  Loss:     0.3013 Validation Accuracy: 0.873200
Epoch 30, CIFAR-10 Batch 29:  Loss:     0.2432 Validation Accuracy: 0.879600
Epoch 30, CIFAR-10 Batch 30:  Loss:     0.1505 Validation Accuracy: 0.874000
Epoch 30, CIFAR-10 Batch 31:  Loss:     0.2132 Validation Accuracy: 0.864000
Epoch 30, CIFAR-10 Batch 32:  Loss:     0.1702 Validation Accuracy: 0.871200
Epoch 30, CIFAR-10 Batch 33:  Loss:     0.3525 Validation Accuracy: 0.876400
Epoch 30, CIFAR-10 Batch 34:  Loss:     0.3221 Validation Accuracy: 0.855600
Epoch 30, CIFAR-10 Batch 35:  Loss:     0.3490 Validation Accuracy: 0.875000
Epoch 30, CIFAR-10 Batch 36:  Loss:     0.2727 Validation Accuracy: 0.831600
Epoch 30, CIFAR-10 Batch 37:  Loss:     0.1880 Validation Accuracy: 0.881600
Epoch 30, CIFAR-10 Batch 38:  Loss:     0.1653 Validation Accuracy: 0.867600
Epoch 30, CIFAR-10 Batch 39:  Loss:     0.1645 Validation Accuracy: 0.867800
Epoch 30, CIFAR-10 Batch 40:  Loss:     0.2294 Validation Accuracy: 0.870800
Epoch 30, CIFAR-10 Batch 41:  Loss:     0.2200 Validation Accuracy: 0.852400
Epoch 30, CIFAR-10 Batch 42:  Loss:     0.2486 Validation Accuracy: 0.871000
Epoch 30, CIFAR-10 Batch 43:  Loss:     0.3786 Validation Accuracy: 0.861400
Epoch 30, CIFAR-10 Batch 44:  Loss:     0.2692 Validation Accuracy: 0.858400
Epoch 30, CIFAR-10 Batch 45:  Loss:     0.2126 Validation Accuracy: 0.863600
Epoch 30, CIFAR-10 Batch 46:  Loss:     0.2404 Validation Accuracy: 0.869000
Epoch 30, CIFAR-10 Batch 47:  Loss:     0.2243 Validation Accuracy: 0.865000
Epoch 30, CIFAR-10 Batch 48:  Loss:     0.1974 Validation Accuracy: 0.867800
Epoch 30, CIFAR-10 Batch 49:  Loss:     0.2900 Validation Accuracy: 0.856000
Epoch 30, CIFAR-10 Batch 50:  Loss:     0.2339 Validation Accuracy: 0.877800
Epoch 31, CIFAR-10 Batch 1:  Loss:     0.1927 Validation Accuracy: 0.875800
Epoch 31, CIFAR-10 Batch 2:  Loss:     0.1814 Validation Accuracy: 0.864800
Epoch 31, CIFAR-10 Batch 3:  Loss:     0.1477 Validation Accuracy: 0.877800
Epoch 31, CIFAR-10 Batch 4:  Loss:     0.1716 Validation Accuracy: 0.865000
Epoch 31, CIFAR-10 Batch 5:  Loss:     0.2031 Validation Accuracy: 0.868800
Epoch 31, CIFAR-10 Batch 6:  Loss:     0.3377 Validation Accuracy: 0.876400
Epoch 31, CIFAR-10 Batch 7:  Loss:     0.1915 Validation Accuracy: 0.854600
Epoch 31, CIFAR-10 Batch 8:  Loss:     0.2434 Validation Accuracy: 0.872200
Epoch 31, CIFAR-10 Batch 9:  Loss:     0.2263 Validation Accuracy: 0.865600
Epoch 31, CIFAR-10 Batch 10:  Loss:     0.1494 Validation Accuracy: 0.866200
Epoch 31, CIFAR-10 Batch 11:  Loss:     0.2469 Validation Accuracy: 0.855200
Epoch 31, CIFAR-10 Batch 12:  Loss:     0.1858 Validation Accuracy: 0.865000
Epoch 31, CIFAR-10 Batch 13:  Loss:     0.2545 Validation Accuracy: 0.859400
Epoch 31, CIFAR-10 Batch 14:  Loss:     0.2409 Validation Accuracy: 0.861600
Epoch 31, CIFAR-10 Batch 15:  Loss:     0.2032 Validation Accuracy: 0.855800
Epoch 31, CIFAR-10 Batch 16:  Loss:     0.2230 Validation Accuracy: 0.863000
Epoch 31, CIFAR-10 Batch 17:  Loss:     0.3270 Validation Accuracy: 0.872600
Epoch 31, CIFAR-10 Batch 18:  Loss:     0.1985 Validation Accuracy: 0.872000
Epoch 31, CIFAR-10 Batch 19:  Loss:     0.1513 Validation Accuracy: 0.873400
Epoch 31, CIFAR-10 Batch 20:  Loss:     0.2925 Validation Accuracy: 0.864400
Epoch 31, CIFAR-10 Batch 21:  Loss:     0.1614 Validation Accuracy: 0.866600
Epoch 31, CIFAR-10 Batch 22:  Loss:     0.2246 Validation Accuracy: 0.878600
Epoch 31, CIFAR-10 Batch 23:  Loss:     0.2680 Validation Accuracy: 0.871800
Epoch 31, CIFAR-10 Batch 24:  Loss:     0.2883 Validation Accuracy: 0.871000
Epoch 31, CIFAR-10 Batch 25:  Loss:     0.2079 Validation Accuracy: 0.868800
Epoch 31, CIFAR-10 Batch 26:  Loss:     0.1913 Validation Accuracy: 0.880800
Epoch 31, CIFAR-10 Batch 27:  Loss:     0.1673 Validation Accuracy: 0.863400
Epoch 31, CIFAR-10 Batch 28:  Loss:     0.3416 Validation Accuracy: 0.868600
Epoch 31, CIFAR-10 Batch 29:  Loss:     0.2056 Validation Accuracy: 0.869600
Epoch 31, CIFAR-10 Batch 30:  Loss:     0.1595 Validation Accuracy: 0.869000
Epoch 31, CIFAR-10 Batch 31:  Loss:     0.2002 Validation Accuracy: 0.866200
Epoch 31, CIFAR-10 Batch 32:  Loss:     0.1931 Validation Accuracy: 0.869800
Epoch 31, CIFAR-10 Batch 33:  Loss:     0.3112 Validation Accuracy: 0.876400
Epoch 31, CIFAR-10 Batch 34:  Loss:     0.3639 Validation Accuracy: 0.867000
Epoch 31, CIFAR-10 Batch 35:  Loss:     0.3292 Validation Accuracy: 0.864200
Epoch 31, CIFAR-10 Batch 36:  Loss:     0.3158 Validation Accuracy: 0.872400
Epoch 31, CIFAR-10 Batch 37:  Loss:     0.1875 Validation Accuracy: 0.873800
Epoch 31, CIFAR-10 Batch 38:  Loss:     0.1507 Validation Accuracy: 0.867800
Epoch 31, CIFAR-10 Batch 39:  Loss:     0.1906 Validation Accuracy: 0.861400
Epoch 31, CIFAR-10 Batch 40:  Loss:     0.3062 Validation Accuracy: 0.863600
Epoch 31, CIFAR-10 Batch 41:  Loss:     0.2323 Validation Accuracy: 0.865200
Epoch 31, CIFAR-10 Batch 42:  Loss:     0.2498 Validation Accuracy: 0.862200
Epoch 31, CIFAR-10 Batch 43:  Loss:     0.3497 Validation Accuracy: 0.884400
Epoch 31, CIFAR-10 Batch 44:  Loss:     0.2196 Validation Accuracy: 0.870000
Epoch 31, CIFAR-10 Batch 45:  Loss:     0.2169 Validation Accuracy: 0.871800
Epoch 31, CIFAR-10 Batch 46:  Loss:     0.2734 Validation Accuracy: 0.858400
Epoch 31, CIFAR-10 Batch 47:  Loss:     0.1854 Validation Accuracy: 0.872000
Epoch 31, CIFAR-10 Batch 48:  Loss:     0.2482 Validation Accuracy: 0.875400
Epoch 31, CIFAR-10 Batch 49:  Loss:     0.2968 Validation Accuracy: 0.848800
Epoch 31, CIFAR-10 Batch 50:  Loss:     0.2762 Validation Accuracy: 0.878600
Epoch 32, CIFAR-10 Batch 1:  Loss:     0.1467 Validation Accuracy: 0.861200
Epoch 32, CIFAR-10 Batch 2:  Loss:     0.2273 Validation Accuracy: 0.870400
Epoch 32, CIFAR-10 Batch 3:  Loss:     0.2057 Validation Accuracy: 0.875000
Epoch 32, CIFAR-10 Batch 4:  Loss:     0.1730 Validation Accuracy: 0.849000
Epoch 32, CIFAR-10 Batch 5:  Loss:     0.1932 Validation Accuracy: 0.873400
Epoch 32, CIFAR-10 Batch 6:  Loss:     0.3887 Validation Accuracy: 0.873800
Epoch 32, CIFAR-10 Batch 7:  Loss:     0.1899 Validation Accuracy: 0.863600
Epoch 32, CIFAR-10 Batch 8:  Loss:     0.2765 Validation Accuracy: 0.869400
Epoch 32, CIFAR-10 Batch 9:  Loss:     0.2022 Validation Accuracy: 0.866000
Epoch 32, CIFAR-10 Batch 10:  Loss:     0.1461 Validation Accuracy: 0.868200
Epoch 32, CIFAR-10 Batch 11:  Loss:     0.2198 Validation Accuracy: 0.867000
Epoch 32, CIFAR-10 Batch 12:  Loss:     0.2266 Validation Accuracy: 0.861000
Epoch 32, CIFAR-10 Batch 13:  Loss:     0.2143 Validation Accuracy: 0.876400
Epoch 32, CIFAR-10 Batch 14:  Loss:     0.2611 Validation Accuracy: 0.866400
Epoch 32, CIFAR-10 Batch 15:  Loss:     0.2213 Validation Accuracy: 0.873600
Epoch 32, CIFAR-10 Batch 16:  Loss:     0.2107 Validation Accuracy: 0.874600
Epoch 32, CIFAR-10 Batch 17:  Loss:     0.3042 Validation Accuracy: 0.878400
Epoch 32, CIFAR-10 Batch 18:  Loss:     0.2166 Validation Accuracy: 0.867200
Epoch 32, CIFAR-10 Batch 19:  Loss:     0.1484 Validation Accuracy: 0.872200
Epoch 32, CIFAR-10 Batch 20:  Loss:     0.2967 Validation Accuracy: 0.864400
Epoch 32, CIFAR-10 Batch 21:  Loss:     0.1864 Validation Accuracy: 0.871400
Epoch 32, CIFAR-10 Batch 22:  Loss:     0.2450 Validation Accuracy: 0.870400
Epoch 32, CIFAR-10 Batch 23:  Loss:     0.2348 Validation Accuracy: 0.858600
Epoch 32, CIFAR-10 Batch 24:  Loss:     0.2314 Validation Accuracy: 0.879000
Epoch 32, CIFAR-10 Batch 25:  Loss:     0.2439 Validation Accuracy: 0.877200
Epoch 32, CIFAR-10 Batch 26:  Loss:     0.1947 Validation Accuracy: 0.876400
Epoch 32, CIFAR-10 Batch 27:  Loss:     0.1590 Validation Accuracy: 0.863800
Epoch 32, CIFAR-10 Batch 28:  Loss:     0.3181 Validation Accuracy: 0.870200
Epoch 32, CIFAR-10 Batch 29:  Loss:     0.2132 Validation Accuracy: 0.859600
Epoch 32, CIFAR-10 Batch 30:  Loss:     0.1518 Validation Accuracy: 0.861800
Epoch 32, CIFAR-10 Batch 31:  Loss:     0.1993 Validation Accuracy: 0.833600
Epoch 32, CIFAR-10 Batch 32:  Loss:     0.1638 Validation Accuracy: 0.857400
Epoch 32, CIFAR-10 Batch 33:  Loss:     0.3506 Validation Accuracy: 0.871400
Epoch 32, CIFAR-10 Batch 34:  Loss:     0.3393 Validation Accuracy: 0.866000
Epoch 32, CIFAR-10 Batch 35:  Loss:     0.3358 Validation Accuracy: 0.875600
Epoch 32, CIFAR-10 Batch 36:  Loss:     0.2759 Validation Accuracy: 0.863200
Epoch 32, CIFAR-10 Batch 37:  Loss:     0.2104 Validation Accuracy: 0.876400
Epoch 32, CIFAR-10 Batch 38:  Loss:     0.1469 Validation Accuracy: 0.878400
Epoch 32, CIFAR-10 Batch 39:  Loss:     0.1468 Validation Accuracy: 0.872000
Epoch 32, CIFAR-10 Batch 40:  Loss:     0.2280 Validation Accuracy: 0.853800
Epoch 32, CIFAR-10 Batch 41:  Loss:     0.1929 Validation Accuracy: 0.872200
Epoch 32, CIFAR-10 Batch 42:  Loss:     0.2628 Validation Accuracy: 0.862600
Epoch 32, CIFAR-10 Batch 43:  Loss:     0.2862 Validation Accuracy: 0.865600
Epoch 32, CIFAR-10 Batch 44:  Loss:     0.2543 Validation Accuracy: 0.858600
Epoch 32, CIFAR-10 Batch 45:  Loss:     0.1713 Validation Accuracy: 0.870400
Epoch 32, CIFAR-10 Batch 46:  Loss:     0.2619 Validation Accuracy: 0.869000
Epoch 32, CIFAR-10 Batch 47:  Loss:     0.1953 Validation Accuracy: 0.872800
Epoch 32, CIFAR-10 Batch 48:  Loss:     0.2643 Validation Accuracy: 0.864200
Epoch 32, CIFAR-10 Batch 49:  Loss:     0.2948 Validation Accuracy: 0.875000
Epoch 32, CIFAR-10 Batch 50:  Loss:     0.1998 Validation Accuracy: 0.877000
Epoch 33, CIFAR-10 Batch 1:  Loss:     0.1843 Validation Accuracy: 0.885200
Epoch 33, CIFAR-10 Batch 2:  Loss:     0.1608 Validation Accuracy: 0.885200
Epoch 33, CIFAR-10 Batch 3:  Loss:     0.1554 Validation Accuracy: 0.878600
Epoch 33, CIFAR-10 Batch 4:  Loss:     0.1803 Validation Accuracy: 0.870400
Epoch 33, CIFAR-10 Batch 5:  Loss:     0.2019 Validation Accuracy: 0.865400
Epoch 33, CIFAR-10 Batch 6:  Loss:     0.3900 Validation Accuracy: 0.871000
Epoch 33, CIFAR-10 Batch 7:  Loss:     0.1516 Validation Accuracy: 0.860200
Epoch 33, CIFAR-10 Batch 8:  Loss:     0.3159 Validation Accuracy: 0.875800
Epoch 33, CIFAR-10 Batch 9:  Loss:     0.1899 Validation Accuracy: 0.862200
Epoch 33, CIFAR-10 Batch 10:  Loss:     0.1508 Validation Accuracy: 0.865000
Epoch 33, CIFAR-10 Batch 11:  Loss:     0.2517 Validation Accuracy: 0.872400
Epoch 33, CIFAR-10 Batch 12:  Loss:     0.1889 Validation Accuracy: 0.860800
Epoch 33, CIFAR-10 Batch 13:  Loss:     0.2177 Validation Accuracy: 0.880000
Epoch 33, CIFAR-10 Batch 14:  Loss:     0.2378 Validation Accuracy: 0.866000
Epoch 33, CIFAR-10 Batch 15:  Loss:     0.1777 Validation Accuracy: 0.854800
Epoch 33, CIFAR-10 Batch 16:  Loss:     0.1899 Validation Accuracy: 0.866200
Epoch 33, CIFAR-10 Batch 17:  Loss:     0.4032 Validation Accuracy: 0.867800
Epoch 33, CIFAR-10 Batch 18:  Loss:     0.1839 Validation Accuracy: 0.862200
Epoch 33, CIFAR-10 Batch 19:  Loss:     0.1497 Validation Accuracy: 0.863200
Epoch 33, CIFAR-10 Batch 20:  Loss:     0.2883 Validation Accuracy: 0.874200
Epoch 33, CIFAR-10 Batch 21:  Loss:     0.1558 Validation Accuracy: 0.869200
Epoch 33, CIFAR-10 Batch 22:  Loss:     0.2234 Validation Accuracy: 0.870400
Epoch 33, CIFAR-10 Batch 23:  Loss:     0.2573 Validation Accuracy: 0.852200
Epoch 33, CIFAR-10 Batch 24:  Loss:     0.2530 Validation Accuracy: 0.877600
Epoch 33, CIFAR-10 Batch 25:  Loss:     0.2511 Validation Accuracy: 0.846800
Epoch 33, CIFAR-10 Batch 26:  Loss:     0.1888 Validation Accuracy: 0.877800
Epoch 33, CIFAR-10 Batch 27:  Loss:     0.1391 Validation Accuracy: 0.845800
Epoch 33, CIFAR-10 Batch 28:  Loss:     0.3190 Validation Accuracy: 0.879200
Epoch 33, CIFAR-10 Batch 29:  Loss:     0.2146 Validation Accuracy: 0.872600
Epoch 33, CIFAR-10 Batch 30:  Loss:     0.1494 Validation Accuracy: 0.879200
Epoch 33, CIFAR-10 Batch 31:  Loss:     0.1656 Validation Accuracy: 0.871800
Epoch 33, CIFAR-10 Batch 32:  Loss:     0.1454 Validation Accuracy: 0.879400
Epoch 33, CIFAR-10 Batch 33:  Loss:     0.2875 Validation Accuracy: 0.860800
Epoch 33, CIFAR-10 Batch 34:  Loss:     0.3535 Validation Accuracy: 0.854800
Epoch 33, CIFAR-10 Batch 35:  Loss:     0.3138 Validation Accuracy: 0.862600
Epoch 33, CIFAR-10 Batch 36:  Loss:     0.2747 Validation Accuracy: 0.874400
Epoch 33, CIFAR-10 Batch 37:  Loss:     0.2044 Validation Accuracy: 0.872800
Epoch 33, CIFAR-10 Batch 38:  Loss:     0.1556 Validation Accuracy: 0.866200
Epoch 33, CIFAR-10 Batch 39:  Loss:     0.1399 Validation Accuracy: 0.870200
Epoch 33, CIFAR-10 Batch 40:  Loss:     0.2859 Validation Accuracy: 0.871400
Epoch 33, CIFAR-10 Batch 41:  Loss:     0.2395 Validation Accuracy: 0.869600
Epoch 33, CIFAR-10 Batch 42:  Loss:     0.2283 Validation Accuracy: 0.870200
Epoch 33, CIFAR-10 Batch 43:  Loss:     0.2950 Validation Accuracy: 0.882400
Epoch 33, CIFAR-10 Batch 44:  Loss:     0.2377 Validation Accuracy: 0.859400
Epoch 33, CIFAR-10 Batch 45:  Loss:     0.2120 Validation Accuracy: 0.871000
Epoch 33, CIFAR-10 Batch 46:  Loss:     0.2467 Validation Accuracy: 0.868200
Epoch 33, CIFAR-10 Batch 47:  Loss:     0.2206 Validation Accuracy: 0.870400
Epoch 33, CIFAR-10 Batch 48:  Loss:     0.2146 Validation Accuracy: 0.869800
Epoch 33, CIFAR-10 Batch 49:  Loss:     0.3281 Validation Accuracy: 0.873600
Epoch 33, CIFAR-10 Batch 50:  Loss:     0.1853 Validation Accuracy: 0.864000
Epoch 34, CIFAR-10 Batch 1:  Loss:     0.2017 Validation Accuracy: 0.878800
Epoch 34, CIFAR-10 Batch 2:  Loss:     0.2099 Validation Accuracy: 0.849600
Epoch 34, CIFAR-10 Batch 3:  Loss:     0.1762 Validation Accuracy: 0.877800
Epoch 34, CIFAR-10 Batch 4:  Loss:     0.1552 Validation Accuracy: 0.878800
Epoch 34, CIFAR-10 Batch 5:  Loss:     0.2433 Validation Accuracy: 0.880000
Epoch 34, CIFAR-10 Batch 6:  Loss:     0.3420 Validation Accuracy: 0.872000
Epoch 34, CIFAR-10 Batch 7:  Loss:     0.1781 Validation Accuracy: 0.870000
Epoch 34, CIFAR-10 Batch 8:  Loss:     0.2693 Validation Accuracy: 0.868200
Epoch 34, CIFAR-10 Batch 9:  Loss:     0.1974 Validation Accuracy: 0.874000
Epoch 34, CIFAR-10 Batch 10:  Loss:     0.1410 Validation Accuracy: 0.878800
Epoch 34, CIFAR-10 Batch 11:  Loss:     0.2205 Validation Accuracy: 0.875600
Epoch 34, CIFAR-10 Batch 12:  Loss:     0.2168 Validation Accuracy: 0.867200
Epoch 34, CIFAR-10 Batch 13:  Loss:     0.2179 Validation Accuracy: 0.869200
Epoch 34, CIFAR-10 Batch 14:  Loss:     0.2163 Validation Accuracy: 0.878200
Epoch 34, CIFAR-10 Batch 15:  Loss:     0.2282 Validation Accuracy: 0.882200
Epoch 34, CIFAR-10 Batch 16:  Loss:     0.1848 Validation Accuracy: 0.858600
Epoch 34, CIFAR-10 Batch 17:  Loss:     0.3001 Validation Accuracy: 0.880400
Epoch 34, CIFAR-10 Batch 18:  Loss:     0.2071 Validation Accuracy: 0.856400
Epoch 34, CIFAR-10 Batch 19:  Loss:     0.1515 Validation Accuracy: 0.866200
Epoch 34, CIFAR-10 Batch 20:  Loss:     0.3059 Validation Accuracy: 0.875200
Epoch 34, CIFAR-10 Batch 21:  Loss:     0.1684 Validation Accuracy: 0.872400
Epoch 34, CIFAR-10 Batch 22:  Loss:     0.2094 Validation Accuracy: 0.868000
Epoch 34, CIFAR-10 Batch 23:  Loss:     0.2221 Validation Accuracy: 0.871000
Epoch 34, CIFAR-10 Batch 24:  Loss:     0.2010 Validation Accuracy: 0.881600
Epoch 34, CIFAR-10 Batch 25:  Loss:     0.2683 Validation Accuracy: 0.874800
Epoch 34, CIFAR-10 Batch 26:  Loss:     0.2019 Validation Accuracy: 0.877800
Epoch 34, CIFAR-10 Batch 27:  Loss:     0.1667 Validation Accuracy: 0.873200
Epoch 34, CIFAR-10 Batch 28:  Loss:     0.3222 Validation Accuracy: 0.876200
Epoch 34, CIFAR-10 Batch 29:  Loss:     0.2633 Validation Accuracy: 0.874200
Epoch 34, CIFAR-10 Batch 30:  Loss:     0.1582 Validation Accuracy: 0.872800
Epoch 34, CIFAR-10 Batch 31:  Loss:     0.1847 Validation Accuracy: 0.865000
Epoch 34, CIFAR-10 Batch 32:  Loss:     0.2062 Validation Accuracy: 0.872800
Epoch 34, CIFAR-10 Batch 33:  Loss:     0.3006 Validation Accuracy: 0.864200
Epoch 34, CIFAR-10 Batch 34:  Loss:     0.3342 Validation Accuracy: 0.865400
Epoch 34, CIFAR-10 Batch 35:  Loss:     0.2983 Validation Accuracy: 0.879400
Epoch 34, CIFAR-10 Batch 36:  Loss:     0.2764 Validation Accuracy: 0.860400
Epoch 34, CIFAR-10 Batch 37:  Loss:     0.2021 Validation Accuracy: 0.854800
Epoch 34, CIFAR-10 Batch 38:  Loss:     0.1469 Validation Accuracy: 0.881400
Epoch 34, CIFAR-10 Batch 39:  Loss:     0.1684 Validation Accuracy: 0.870400
Epoch 34, CIFAR-10 Batch 40:  Loss:     0.2601 Validation Accuracy: 0.859200
Epoch 34, CIFAR-10 Batch 41:  Loss:     0.2012 Validation Accuracy: 0.875800
Epoch 34, CIFAR-10 Batch 42:  Loss:     0.2008 Validation Accuracy: 0.878800
Epoch 34, CIFAR-10 Batch 43:  Loss:     0.2897 Validation Accuracy: 0.885200
Epoch 34, CIFAR-10 Batch 44:  Loss:     0.2230 Validation Accuracy: 0.863800
Epoch 34, CIFAR-10 Batch 45:  Loss:     0.1988 Validation Accuracy: 0.877600
Epoch 34, CIFAR-10 Batch 46:  Loss:     0.2578 Validation Accuracy: 0.876200
Epoch 34, CIFAR-10 Batch 47:  Loss:     0.1848 Validation Accuracy: 0.876400
Epoch 34, CIFAR-10 Batch 48:  Loss:     0.2146 Validation Accuracy: 0.869800
Epoch 34, CIFAR-10 Batch 49:  Loss:     0.3295 Validation Accuracy: 0.875400
Epoch 34, CIFAR-10 Batch 50:  Loss:     0.2082 Validation Accuracy: 0.871400
Epoch 35, CIFAR-10 Batch 1:  Loss:     0.1657 Validation Accuracy: 0.870000
Epoch 35, CIFAR-10 Batch 2:  Loss:     0.1830 Validation Accuracy: 0.861200
Epoch 35, CIFAR-10 Batch 3:  Loss:     0.2055 Validation Accuracy: 0.868000
Epoch 35, CIFAR-10 Batch 4:  Loss:     0.1693 Validation Accuracy: 0.866400
Epoch 35, CIFAR-10 Batch 5:  Loss:     0.1888 Validation Accuracy: 0.886000
Epoch 35, CIFAR-10 Batch 6:  Loss:     0.2731 Validation Accuracy: 0.878200
Epoch 35, CIFAR-10 Batch 7:  Loss:     0.2048 Validation Accuracy: 0.855600
Epoch 35, CIFAR-10 Batch 8:  Loss:     0.2869 Validation Accuracy: 0.875000
Epoch 35, CIFAR-10 Batch 9:  Loss:     0.1876 Validation Accuracy: 0.879000
Epoch 35, CIFAR-10 Batch 10:  Loss:     0.1608 Validation Accuracy: 0.877400
Epoch 35, CIFAR-10 Batch 11:  Loss:     0.2122 Validation Accuracy: 0.874800
Epoch 35, CIFAR-10 Batch 12:  Loss:     0.1823 Validation Accuracy: 0.852600
Epoch 35, CIFAR-10 Batch 13:  Loss:     0.2431 Validation Accuracy: 0.859000
Epoch 35, CIFAR-10 Batch 14:  Loss:     0.1979 Validation Accuracy: 0.859600
Epoch 35, CIFAR-10 Batch 15:  Loss:     0.2054 Validation Accuracy: 0.881000
Epoch 35, CIFAR-10 Batch 16:  Loss:     0.1767 Validation Accuracy: 0.870200
Epoch 35, CIFAR-10 Batch 17:  Loss:     0.2871 Validation Accuracy: 0.878600
Epoch 35, CIFAR-10 Batch 18:  Loss:     0.1954 Validation Accuracy: 0.876600
Epoch 35, CIFAR-10 Batch 19:  Loss:     0.1935 Validation Accuracy: 0.876600
Epoch 35, CIFAR-10 Batch 20:  Loss:     0.2834 Validation Accuracy: 0.875000
Epoch 35, CIFAR-10 Batch 21:  Loss:     0.1756 Validation Accuracy: 0.874800
Epoch 35, CIFAR-10 Batch 22:  Loss:     0.2025 Validation Accuracy: 0.874600
Epoch 35, CIFAR-10 Batch 23:  Loss:     0.2516 Validation Accuracy: 0.866400
Epoch 35, CIFAR-10 Batch 24:  Loss:     0.2735 Validation Accuracy: 0.864600
Epoch 35, CIFAR-10 Batch 25:  Loss:     0.2395 Validation Accuracy: 0.870800
Epoch 35, CIFAR-10 Batch 26:  Loss:     0.1859 Validation Accuracy: 0.875200
Epoch 35, CIFAR-10 Batch 27:  Loss:     0.1472 Validation Accuracy: 0.855400
Epoch 35, CIFAR-10 Batch 28:  Loss:     0.3224 Validation Accuracy: 0.861200
Epoch 35, CIFAR-10 Batch 29:  Loss:     0.1601 Validation Accuracy: 0.870000
Epoch 35, CIFAR-10 Batch 30:  Loss:     0.1506 Validation Accuracy: 0.873400
Epoch 35, CIFAR-10 Batch 31:  Loss:     0.1783 Validation Accuracy: 0.869200
Epoch 35, CIFAR-10 Batch 32:  Loss:     0.1553 Validation Accuracy: 0.877600
Epoch 35, CIFAR-10 Batch 33:  Loss:     0.3242 Validation Accuracy: 0.867600
Epoch 35, CIFAR-10 Batch 34:  Loss:     0.3465 Validation Accuracy: 0.859200
Epoch 35, CIFAR-10 Batch 35:  Loss:     0.3122 Validation Accuracy: 0.874600
Epoch 35, CIFAR-10 Batch 36:  Loss:     0.3434 Validation Accuracy: 0.867000
Epoch 35, CIFAR-10 Batch 37:  Loss:     0.1873 Validation Accuracy: 0.875400
Epoch 35, CIFAR-10 Batch 38:  Loss:     0.1487 Validation Accuracy: 0.876400
Epoch 35, CIFAR-10 Batch 39:  Loss:     0.1487 Validation Accuracy: 0.864600
Epoch 35, CIFAR-10 Batch 40:  Loss:     0.1918 Validation Accuracy: 0.871000
Epoch 35, CIFAR-10 Batch 41:  Loss:     0.2293 Validation Accuracy: 0.856400
Epoch 35, CIFAR-10 Batch 42:  Loss:     0.2273 Validation Accuracy: 0.877800
Epoch 35, CIFAR-10 Batch 43:  Loss:     0.2516 Validation Accuracy: 0.869800
Epoch 35, CIFAR-10 Batch 44:  Loss:     0.2233 Validation Accuracy: 0.870200
Epoch 35, CIFAR-10 Batch 45:  Loss:     0.2061 Validation Accuracy: 0.881600
Epoch 35, CIFAR-10 Batch 46:  Loss:     0.2566 Validation Accuracy: 0.879400
Epoch 35, CIFAR-10 Batch 47:  Loss:     0.1711 Validation Accuracy: 0.873000
Epoch 35, CIFAR-10 Batch 48:  Loss:     0.2538 Validation Accuracy: 0.876600
Epoch 35, CIFAR-10 Batch 49:  Loss:     0.2097 Validation Accuracy: 0.857600
Epoch 35, CIFAR-10 Batch 50:  Loss:     0.1649 Validation Accuracy: 0.868400
Epoch 36, CIFAR-10 Batch 1:  Loss:     0.1682 Validation Accuracy: 0.879000
Epoch 36, CIFAR-10 Batch 2:  Loss:     0.2077 Validation Accuracy: 0.869600
Epoch 36, CIFAR-10 Batch 3:  Loss:     0.1404 Validation Accuracy: 0.874800
Epoch 36, CIFAR-10 Batch 4:  Loss:     0.1670 Validation Accuracy: 0.879000
Epoch 36, CIFAR-10 Batch 5:  Loss:     0.2183 Validation Accuracy: 0.877800
Epoch 36, CIFAR-10 Batch 6:  Loss:     0.3558 Validation Accuracy: 0.860600
Epoch 36, CIFAR-10 Batch 7:  Loss:     0.1804 Validation Accuracy: 0.862000
Epoch 36, CIFAR-10 Batch 8:  Loss:     0.2530 Validation Accuracy: 0.864800
Epoch 36, CIFAR-10 Batch 9:  Loss:     0.2510 Validation Accuracy: 0.870400
Epoch 36, CIFAR-10 Batch 10:  Loss:     0.1406 Validation Accuracy: 0.873200
Epoch 36, CIFAR-10 Batch 11:  Loss:     0.2185 Validation Accuracy: 0.873800
Epoch 36, CIFAR-10 Batch 12:  Loss:     0.2259 Validation Accuracy: 0.837000
Epoch 36, CIFAR-10 Batch 13:  Loss:     0.1863 Validation Accuracy: 0.879400
Epoch 36, CIFAR-10 Batch 14:  Loss:     0.2030 Validation Accuracy: 0.877000
Epoch 36, CIFAR-10 Batch 15:  Loss:     0.1674 Validation Accuracy: 0.867400
Epoch 36, CIFAR-10 Batch 16:  Loss:     0.1675 Validation Accuracy: 0.843800
Epoch 36, CIFAR-10 Batch 17:  Loss:     0.2903 Validation Accuracy: 0.875600
Epoch 36, CIFAR-10 Batch 18:  Loss:     0.1601 Validation Accuracy: 0.867600
Epoch 36, CIFAR-10 Batch 19:  Loss:     0.1553 Validation Accuracy: 0.875000
Epoch 36, CIFAR-10 Batch 20:  Loss:     0.2157 Validation Accuracy: 0.875400
Epoch 36, CIFAR-10 Batch 21:  Loss:     0.1767 Validation Accuracy: 0.873000
Epoch 36, CIFAR-10 Batch 22:  Loss:     0.2110 Validation Accuracy: 0.881600
Epoch 36, CIFAR-10 Batch 23:  Loss:     0.2179 Validation Accuracy: 0.880400
Epoch 36, CIFAR-10 Batch 24:  Loss:     0.2945 Validation Accuracy: 0.885800
Epoch 36, CIFAR-10 Batch 25:  Loss:     0.2411 Validation Accuracy: 0.871200
Epoch 36, CIFAR-10 Batch 26:  Loss:     0.1856 Validation Accuracy: 0.873600
Epoch 36, CIFAR-10 Batch 27:  Loss:     0.1672 Validation Accuracy: 0.879400
Epoch 36, CIFAR-10 Batch 28:  Loss:     0.3303 Validation Accuracy: 0.881000
Epoch 36, CIFAR-10 Batch 29:  Loss:     0.1673 Validation Accuracy: 0.869200
Epoch 36, CIFAR-10 Batch 30:  Loss:     0.1424 Validation Accuracy: 0.871000
Epoch 36, CIFAR-10 Batch 31:  Loss:     0.2060 Validation Accuracy: 0.860600
Epoch 36, CIFAR-10 Batch 32:  Loss:     0.1815 Validation Accuracy: 0.875800
Epoch 36, CIFAR-10 Batch 33:  Loss:     0.3502 Validation Accuracy: 0.865800
Epoch 36, CIFAR-10 Batch 34:  Loss:     0.3330 Validation Accuracy: 0.867600
Epoch 36, CIFAR-10 Batch 35:  Loss:     0.2808 Validation Accuracy: 0.876800
Epoch 36, CIFAR-10 Batch 36:  Loss:     0.2547 Validation Accuracy: 0.874000
Epoch 36, CIFAR-10 Batch 37:  Loss:     0.1591 Validation Accuracy: 0.875200
Epoch 36, CIFAR-10 Batch 38:  Loss:     0.1553 Validation Accuracy: 0.869000
Epoch 36, CIFAR-10 Batch 39:  Loss:     0.1573 Validation Accuracy: 0.865600
Epoch 36, CIFAR-10 Batch 40:  Loss:     0.2586 Validation Accuracy: 0.846800
Epoch 36, CIFAR-10 Batch 41:  Loss:     0.2206 Validation Accuracy: 0.871200
Epoch 36, CIFAR-10 Batch 42:  Loss:     0.2160 Validation Accuracy: 0.875800
Epoch 36, CIFAR-10 Batch 43:  Loss:     0.2645 Validation Accuracy: 0.866800
Epoch 36, CIFAR-10 Batch 44:  Loss:     0.1950 Validation Accuracy: 0.869600
Epoch 36, CIFAR-10 Batch 45:  Loss:     0.1989 Validation Accuracy: 0.866800
Epoch 36, CIFAR-10 Batch 46:  Loss:     0.2447 Validation Accuracy: 0.876800
Epoch 36, CIFAR-10 Batch 47:  Loss:     0.1836 Validation Accuracy: 0.880800
Epoch 36, CIFAR-10 Batch 48:  Loss:     0.2525 Validation Accuracy: 0.879200
Epoch 36, CIFAR-10 Batch 49:  Loss:     0.2241 Validation Accuracy: 0.869800
Epoch 36, CIFAR-10 Batch 50:  Loss:     0.1939 Validation Accuracy: 0.883200
Epoch 37, CIFAR-10 Batch 1:  Loss:     0.1841 Validation Accuracy: 0.875200
Epoch 37, CIFAR-10 Batch 2:  Loss:     0.1960 Validation Accuracy: 0.877800
Epoch 37, CIFAR-10 Batch 3:  Loss:     0.1823 Validation Accuracy: 0.871600
Epoch 37, CIFAR-10 Batch 4:  Loss:     0.1736 Validation Accuracy: 0.871400
Epoch 37, CIFAR-10 Batch 5:  Loss:     0.2168 Validation Accuracy: 0.880800
Epoch 37, CIFAR-10 Batch 6:  Loss:     0.3670 Validation Accuracy: 0.858200
Epoch 37, CIFAR-10 Batch 7:  Loss:     0.1631 Validation Accuracy: 0.852200
Epoch 37, CIFAR-10 Batch 8:  Loss:     0.2436 Validation Accuracy: 0.884200
Epoch 37, CIFAR-10 Batch 9:  Loss:     0.2160 Validation Accuracy: 0.878200
Epoch 37, CIFAR-10 Batch 10:  Loss:     0.1349 Validation Accuracy: 0.885600
Epoch 37, CIFAR-10 Batch 11:  Loss:     0.2434 Validation Accuracy: 0.872200
Epoch 37, CIFAR-10 Batch 12:  Loss:     0.2980 Validation Accuracy: 0.877000
Epoch 37, CIFAR-10 Batch 13:  Loss:     0.2651 Validation Accuracy: 0.876400
Epoch 37, CIFAR-10 Batch 14:  Loss:     0.2027 Validation Accuracy: 0.872000
Epoch 37, CIFAR-10 Batch 15:  Loss:     0.1694 Validation Accuracy: 0.869600
Epoch 37, CIFAR-10 Batch 16:  Loss:     0.1567 Validation Accuracy: 0.874000
Epoch 37, CIFAR-10 Batch 17:  Loss:     0.3017 Validation Accuracy: 0.875400
Epoch 37, CIFAR-10 Batch 18:  Loss:     0.1830 Validation Accuracy: 0.860200
Epoch 37, CIFAR-10 Batch 19:  Loss:     0.1630 Validation Accuracy: 0.864600
Epoch 37, CIFAR-10 Batch 20:  Loss:     0.2504 Validation Accuracy: 0.865200
Epoch 37, CIFAR-10 Batch 21:  Loss:     0.1473 Validation Accuracy: 0.877200
Epoch 37, CIFAR-10 Batch 22:  Loss:     0.1909 Validation Accuracy: 0.879000
Epoch 37, CIFAR-10 Batch 23:  Loss:     0.1854 Validation Accuracy: 0.870400
Epoch 37, CIFAR-10 Batch 24:  Loss:     0.2260 Validation Accuracy: 0.887200
Epoch 37, CIFAR-10 Batch 25:  Loss:     0.2706 Validation Accuracy: 0.870600
Epoch 37, CIFAR-10 Batch 26:  Loss:     0.1813 Validation Accuracy: 0.883800
Epoch 37, CIFAR-10 Batch 27:  Loss:     0.1559 Validation Accuracy: 0.862600
Epoch 37, CIFAR-10 Batch 28:  Loss:     0.3487 Validation Accuracy: 0.875400
Epoch 37, CIFAR-10 Batch 29:  Loss:     0.1754 Validation Accuracy: 0.871200
Epoch 37, CIFAR-10 Batch 30:  Loss:     0.1483 Validation Accuracy: 0.872400
Epoch 37, CIFAR-10 Batch 31:  Loss:     0.2046 Validation Accuracy: 0.865400
Epoch 37, CIFAR-10 Batch 32:  Loss:     0.1710 Validation Accuracy: 0.864400
Epoch 37, CIFAR-10 Batch 33:  Loss:     0.3569 Validation Accuracy: 0.864600
Epoch 37, CIFAR-10 Batch 34:  Loss:     0.3462 Validation Accuracy: 0.872400
Epoch 37, CIFAR-10 Batch 35:  Loss:     0.2719 Validation Accuracy: 0.875600
Epoch 37, CIFAR-10 Batch 36:  Loss:     0.2510 Validation Accuracy: 0.880800
Epoch 37, CIFAR-10 Batch 37:  Loss:     0.1745 Validation Accuracy: 0.868000
Epoch 37, CIFAR-10 Batch 38:  Loss:     0.1708 Validation Accuracy: 0.879400
Epoch 37, CIFAR-10 Batch 39:  Loss:     0.1562 Validation Accuracy: 0.866800
Epoch 37, CIFAR-10 Batch 40:  Loss:     0.2261 Validation Accuracy: 0.851200
Epoch 37, CIFAR-10 Batch 41:  Loss:     0.2203 Validation Accuracy: 0.869600
Epoch 37, CIFAR-10 Batch 42:  Loss:     0.2442 Validation Accuracy: 0.870800
Epoch 37, CIFAR-10 Batch 43:  Loss:     0.2725 Validation Accuracy: 0.881600
Epoch 37, CIFAR-10 Batch 44:  Loss:     0.2392 Validation Accuracy: 0.870400
Epoch 37, CIFAR-10 Batch 45:  Loss:     0.1806 Validation Accuracy: 0.877400
Epoch 37, CIFAR-10 Batch 46:  Loss:     0.1979 Validation Accuracy: 0.869600
Epoch 37, CIFAR-10 Batch 47:  Loss:     0.2143 Validation Accuracy: 0.870200
Epoch 37, CIFAR-10 Batch 48:  Loss:     0.2116 Validation Accuracy: 0.862800
Epoch 37, CIFAR-10 Batch 49:  Loss:     0.2290 Validation Accuracy: 0.872800
Epoch 37, CIFAR-10 Batch 50:  Loss:     0.2138 Validation Accuracy: 0.873200
Epoch 38, CIFAR-10 Batch 1:  Loss:     0.1856 Validation Accuracy: 0.864200
Epoch 38, CIFAR-10 Batch 2:  Loss:     0.2205 Validation Accuracy: 0.868600
Epoch 38, CIFAR-10 Batch 3:  Loss:     0.1936 Validation Accuracy: 0.875800
Epoch 38, CIFAR-10 Batch 4:  Loss:     0.1437 Validation Accuracy: 0.876000
Epoch 38, CIFAR-10 Batch 5:  Loss:     0.1875 Validation Accuracy: 0.887400
Epoch 38, CIFAR-10 Batch 6:  Loss:     0.3098 Validation Accuracy: 0.876200
Epoch 38, CIFAR-10 Batch 7:  Loss:     0.1742 Validation Accuracy: 0.868200
Epoch 38, CIFAR-10 Batch 8:  Loss:     0.3023 Validation Accuracy: 0.875800
Epoch 38, CIFAR-10 Batch 9:  Loss:     0.2440 Validation Accuracy: 0.870000
Epoch 38, CIFAR-10 Batch 10:  Loss:     0.1487 Validation Accuracy: 0.875800
Epoch 38, CIFAR-10 Batch 11:  Loss:     0.2479 Validation Accuracy: 0.872400
Epoch 38, CIFAR-10 Batch 12:  Loss:     0.2010 Validation Accuracy: 0.856400
Epoch 38, CIFAR-10 Batch 13:  Loss:     0.2356 Validation Accuracy: 0.831400
Epoch 38, CIFAR-10 Batch 14:  Loss:     0.1783 Validation Accuracy: 0.872200
Epoch 38, CIFAR-10 Batch 15:  Loss:     0.1861 Validation Accuracy: 0.869600
Epoch 38, CIFAR-10 Batch 16:  Loss:     0.1884 Validation Accuracy: 0.859800
Epoch 38, CIFAR-10 Batch 17:  Loss:     0.2744 Validation Accuracy: 0.877800
Epoch 38, CIFAR-10 Batch 18:  Loss:     0.1765 Validation Accuracy: 0.860400
Epoch 38, CIFAR-10 Batch 19:  Loss:     0.1490 Validation Accuracy: 0.872800
Epoch 38, CIFAR-10 Batch 20:  Loss:     0.3360 Validation Accuracy: 0.865000
Epoch 38, CIFAR-10 Batch 21:  Loss:     0.1641 Validation Accuracy: 0.877400
Epoch 38, CIFAR-10 Batch 22:  Loss:     0.2240 Validation Accuracy: 0.866200
Epoch 38, CIFAR-10 Batch 23:  Loss:     0.2583 Validation Accuracy: 0.873200
Epoch 38, CIFAR-10 Batch 24:  Loss:     0.2295 Validation Accuracy: 0.878800
Epoch 38, CIFAR-10 Batch 25:  Loss:     0.2190 Validation Accuracy: 0.858000
Epoch 38, CIFAR-10 Batch 26:  Loss:     0.1867 Validation Accuracy: 0.879000
Epoch 38, CIFAR-10 Batch 27:  Loss:     0.1465 Validation Accuracy: 0.860400
Epoch 38, CIFAR-10 Batch 28:  Loss:     0.2666 Validation Accuracy: 0.888200
Epoch 38, CIFAR-10 Batch 29:  Loss:     0.1900 Validation Accuracy: 0.882800
Epoch 38, CIFAR-10 Batch 30:  Loss:     0.1456 Validation Accuracy: 0.882000
Epoch 38, CIFAR-10 Batch 31:  Loss:     0.1575 Validation Accuracy: 0.873000
Epoch 38, CIFAR-10 Batch 32:  Loss:     0.1711 Validation Accuracy: 0.851600
Epoch 38, CIFAR-10 Batch 33:  Loss:     0.3085 Validation Accuracy: 0.869800
Epoch 38, CIFAR-10 Batch 34:  Loss:     0.3391 Validation Accuracy: 0.875200
Epoch 38, CIFAR-10 Batch 35:  Loss:     0.2663 Validation Accuracy: 0.855800
Epoch 38, CIFAR-10 Batch 36:  Loss:     0.2768 Validation Accuracy: 0.866800
Epoch 38, CIFAR-10 Batch 37:  Loss:     0.1971 Validation Accuracy: 0.871200
Epoch 38, CIFAR-10 Batch 38:  Loss:     0.1608 Validation Accuracy: 0.862000
Epoch 38, CIFAR-10 Batch 39:  Loss:     0.1441 Validation Accuracy: 0.865800
Epoch 38, CIFAR-10 Batch 40:  Loss:     0.2507 Validation Accuracy: 0.875600
Epoch 38, CIFAR-10 Batch 41:  Loss:     0.2223 Validation Accuracy: 0.857000
Epoch 38, CIFAR-10 Batch 42:  Loss:     0.2146 Validation Accuracy: 0.879200
Epoch 38, CIFAR-10 Batch 43:  Loss:     0.3432 Validation Accuracy: 0.884600
Epoch 38, CIFAR-10 Batch 44:  Loss:     0.2140 Validation Accuracy: 0.858800
Epoch 38, CIFAR-10 Batch 45:  Loss:     0.1547 Validation Accuracy: 0.877400
Epoch 38, CIFAR-10 Batch 46:  Loss:     0.2303 Validation Accuracy: 0.880400
Epoch 38, CIFAR-10 Batch 47:  Loss:     0.2019 Validation Accuracy: 0.880600
Epoch 38, CIFAR-10 Batch 48:  Loss:     0.2001 Validation Accuracy: 0.874400
Epoch 38, CIFAR-10 Batch 49:  Loss:     0.2325 Validation Accuracy: 0.881600
Epoch 38, CIFAR-10 Batch 50:  Loss:     0.1946 Validation Accuracy: 0.884600
Epoch 39, CIFAR-10 Batch 1:  Loss:     0.1751 Validation Accuracy: 0.847400
Epoch 39, CIFAR-10 Batch 2:  Loss:     0.1866 Validation Accuracy: 0.866000
Epoch 39, CIFAR-10 Batch 3:  Loss:     0.1479 Validation Accuracy: 0.877000
Epoch 39, CIFAR-10 Batch 4:  Loss:     0.1929 Validation Accuracy: 0.871600
Epoch 39, CIFAR-10 Batch 5:  Loss:     0.1970 Validation Accuracy: 0.882400
Epoch 39, CIFAR-10 Batch 6:  Loss:     0.3425 Validation Accuracy: 0.873200
Epoch 39, CIFAR-10 Batch 7:  Loss:     0.1494 Validation Accuracy: 0.870800
Epoch 39, CIFAR-10 Batch 8:  Loss:     0.2603 Validation Accuracy: 0.879200
Epoch 39, CIFAR-10 Batch 9:  Loss:     0.2687 Validation Accuracy: 0.881400
Epoch 39, CIFAR-10 Batch 10:  Loss:     0.1527 Validation Accuracy: 0.876000
Epoch 39, CIFAR-10 Batch 11:  Loss:     0.2098 Validation Accuracy: 0.875000
Epoch 39, CIFAR-10 Batch 12:  Loss:     0.1994 Validation Accuracy: 0.868200
Epoch 39, CIFAR-10 Batch 13:  Loss:     0.2043 Validation Accuracy: 0.883600
Epoch 39, CIFAR-10 Batch 14:  Loss:     0.2005 Validation Accuracy: 0.864800
Epoch 39, CIFAR-10 Batch 15:  Loss:     0.1692 Validation Accuracy: 0.882600
Epoch 39, CIFAR-10 Batch 16:  Loss:     0.1649 Validation Accuracy: 0.875400
Epoch 39, CIFAR-10 Batch 17:  Loss:     0.2869 Validation Accuracy: 0.872400
Epoch 39, CIFAR-10 Batch 18:  Loss:     0.1996 Validation Accuracy: 0.871200
Epoch 39, CIFAR-10 Batch 19:  Loss:     0.1458 Validation Accuracy: 0.868600
Epoch 39, CIFAR-10 Batch 20:  Loss:     0.2311 Validation Accuracy: 0.860600
Epoch 39, CIFAR-10 Batch 21:  Loss:     0.1851 Validation Accuracy: 0.860400
Epoch 39, CIFAR-10 Batch 22:  Loss:     0.1808 Validation Accuracy: 0.874400
Epoch 39, CIFAR-10 Batch 23:  Loss:     0.2398 Validation Accuracy: 0.883600
Epoch 39, CIFAR-10 Batch 24:  Loss:     0.1906 Validation Accuracy: 0.880000
Epoch 39, CIFAR-10 Batch 25:  Loss:     0.2164 Validation Accuracy: 0.860200
Epoch 39, CIFAR-10 Batch 26:  Loss:     0.1708 Validation Accuracy: 0.882800
Epoch 39, CIFAR-10 Batch 27:  Loss:     0.1580 Validation Accuracy: 0.871000
Epoch 39, CIFAR-10 Batch 28:  Loss:     0.3131 Validation Accuracy: 0.876800
Epoch 39, CIFAR-10 Batch 29:  Loss:     0.1769 Validation Accuracy: 0.868800
Epoch 39, CIFAR-10 Batch 30:  Loss:     0.1530 Validation Accuracy: 0.874200
Epoch 39, CIFAR-10 Batch 31:  Loss:     0.1508 Validation Accuracy: 0.868600
Epoch 39, CIFAR-10 Batch 32:  Loss:     0.1616 Validation Accuracy: 0.864000
Epoch 39, CIFAR-10 Batch 33:  Loss:     0.2722 Validation Accuracy: 0.868600
Epoch 39, CIFAR-10 Batch 34:  Loss:     0.3553 Validation Accuracy: 0.866600
Epoch 39, CIFAR-10 Batch 35:  Loss:     0.2795 Validation Accuracy: 0.873800
Epoch 39, CIFAR-10 Batch 36:  Loss:     0.2896 Validation Accuracy: 0.865600
Epoch 39, CIFAR-10 Batch 37:  Loss:     0.1772 Validation Accuracy: 0.875000
Epoch 39, CIFAR-10 Batch 38:  Loss:     0.1516 Validation Accuracy: 0.880400
Epoch 39, CIFAR-10 Batch 39:  Loss:     0.1441 Validation Accuracy: 0.874000
Epoch 39, CIFAR-10 Batch 40:  Loss:     0.2280 Validation Accuracy: 0.872400
Epoch 39, CIFAR-10 Batch 41:  Loss:     0.2093 Validation Accuracy: 0.861800
Epoch 39, CIFAR-10 Batch 42:  Loss:     0.2021 Validation Accuracy: 0.865400
Epoch 39, CIFAR-10 Batch 43:  Loss:     0.2832 Validation Accuracy: 0.875600
Epoch 39, CIFAR-10 Batch 44:  Loss:     0.2363 Validation Accuracy: 0.866600
Epoch 39, CIFAR-10 Batch 45:  Loss:     0.1906 Validation Accuracy: 0.879400
Epoch 39, CIFAR-10 Batch 46:  Loss:     0.2073 Validation Accuracy: 0.876200
Epoch 39, CIFAR-10 Batch 47:  Loss:     0.1880 Validation Accuracy: 0.874000
Epoch 39, CIFAR-10 Batch 48:  Loss:     0.1821 Validation Accuracy: 0.885800
Epoch 39, CIFAR-10 Batch 49:  Loss:     0.2253 Validation Accuracy: 0.881000
Epoch 39, CIFAR-10 Batch 50:  Loss:     0.1957 Validation Accuracy: 0.872600
Epoch 40, CIFAR-10 Batch 1:  Loss:     0.1788 Validation Accuracy: 0.869000
Epoch 40, CIFAR-10 Batch 2:  Loss:     0.1865 Validation Accuracy: 0.871800
Epoch 40, CIFAR-10 Batch 3:  Loss:     0.1524 Validation Accuracy: 0.877600
Epoch 40, CIFAR-10 Batch 4:  Loss:     0.1451 Validation Accuracy: 0.871600
Epoch 40, CIFAR-10 Batch 5:  Loss:     0.1864 Validation Accuracy: 0.873600
Epoch 40, CIFAR-10 Batch 6:  Loss:     0.2958 Validation Accuracy: 0.878200
Epoch 40, CIFAR-10 Batch 7:  Loss:     0.1474 Validation Accuracy: 0.867000
Epoch 40, CIFAR-10 Batch 8:  Loss:     0.2627 Validation Accuracy: 0.881200
Epoch 40, CIFAR-10 Batch 9:  Loss:     0.1534 Validation Accuracy: 0.883200
Epoch 40, CIFAR-10 Batch 10:  Loss:     0.1629 Validation Accuracy: 0.878600
Epoch 40, CIFAR-10 Batch 11:  Loss:     0.1693 Validation Accuracy: 0.875400
Epoch 40, CIFAR-10 Batch 12:  Loss:     0.2215 Validation Accuracy: 0.869200
Epoch 40, CIFAR-10 Batch 13:  Loss:     0.1924 Validation Accuracy: 0.869800
Epoch 40, CIFAR-10 Batch 14:  Loss:     0.2280 Validation Accuracy: 0.862400
Epoch 40, CIFAR-10 Batch 15:  Loss:     0.1584 Validation Accuracy: 0.878800
Epoch 40, CIFAR-10 Batch 16:  Loss:     0.1722 Validation Accuracy: 0.872000
Epoch 40, CIFAR-10 Batch 17:  Loss:     0.2437 Validation Accuracy: 0.875200
Epoch 40, CIFAR-10 Batch 18:  Loss:     0.2018 Validation Accuracy: 0.868200
Epoch 40, CIFAR-10 Batch 19:  Loss:     0.1378 Validation Accuracy: 0.876400
Epoch 40, CIFAR-10 Batch 20:  Loss:     0.2963 Validation Accuracy: 0.863800
Epoch 40, CIFAR-10 Batch 21:  Loss:     0.1815 Validation Accuracy: 0.882200
Epoch 40, CIFAR-10 Batch 22:  Loss:     0.2278 Validation Accuracy: 0.861200
Epoch 40, CIFAR-10 Batch 23:  Loss:     0.2115 Validation Accuracy: 0.870000
Epoch 40, CIFAR-10 Batch 24:  Loss:     0.2111 Validation Accuracy: 0.881400
Epoch 40, CIFAR-10 Batch 25:  Loss:     0.2249 Validation Accuracy: 0.870600
Epoch 40, CIFAR-10 Batch 26:  Loss:     0.1759 Validation Accuracy: 0.865800
Epoch 40, CIFAR-10 Batch 27:  Loss:     0.1390 Validation Accuracy: 0.877000
Epoch 40, CIFAR-10 Batch 28:  Loss:     0.2441 Validation Accuracy: 0.876800
Epoch 40, CIFAR-10 Batch 29:  Loss:     0.1943 Validation Accuracy: 0.873600
Epoch 40, CIFAR-10 Batch 30:  Loss:     0.1640 Validation Accuracy: 0.869000
Epoch 40, CIFAR-10 Batch 31:  Loss:     0.1685 Validation Accuracy: 0.866600
Epoch 40, CIFAR-10 Batch 32:  Loss:     0.1550 Validation Accuracy: 0.881600
Epoch 40, CIFAR-10 Batch 33:  Loss:     0.2673 Validation Accuracy: 0.860400
Epoch 40, CIFAR-10 Batch 34:  Loss:     0.2929 Validation Accuracy: 0.869600
Epoch 40, CIFAR-10 Batch 35:  Loss:     0.3021 Validation Accuracy: 0.877600
Epoch 40, CIFAR-10 Batch 36:  Loss:     0.2667 Validation Accuracy: 0.870000
Epoch 40, CIFAR-10 Batch 37:  Loss:     0.1808 Validation Accuracy: 0.875000
Epoch 40, CIFAR-10 Batch 38:  Loss:     0.1612 Validation Accuracy: 0.875600
Epoch 40, CIFAR-10 Batch 39:  Loss:     0.1449 Validation Accuracy: 0.875200
Epoch 40, CIFAR-10 Batch 40:  Loss:     0.2675 Validation Accuracy: 0.863600
Epoch 40, CIFAR-10 Batch 41:  Loss:     0.2008 Validation Accuracy: 0.860400
Epoch 40, CIFAR-10 Batch 42:  Loss:     0.2889 Validation Accuracy: 0.869400
Epoch 40, CIFAR-10 Batch 43:  Loss:     0.2883 Validation Accuracy: 0.866600
Epoch 40, CIFAR-10 Batch 44:  Loss:     0.2490 Validation Accuracy: 0.859400
Epoch 40, CIFAR-10 Batch 45:  Loss:     0.1830 Validation Accuracy: 0.880800
Epoch 40, CIFAR-10 Batch 46:  Loss:     0.2769 Validation Accuracy: 0.860400
Epoch 40, CIFAR-10 Batch 47:  Loss:     0.2050 Validation Accuracy: 0.873000
Epoch 40, CIFAR-10 Batch 48:  Loss:     0.1745 Validation Accuracy: 0.887200
Epoch 40, CIFAR-10 Batch 49:  Loss:     0.2470 Validation Accuracy: 0.870200
Epoch 40, CIFAR-10 Batch 50:  Loss:     0.1679 Validation Accuracy: 0.879200
Epoch 41, CIFAR-10 Batch 1:  Loss:     0.1652 Validation Accuracy: 0.882400
Epoch 41, CIFAR-10 Batch 2:  Loss:     0.1659 Validation Accuracy: 0.864400
Epoch 41, CIFAR-10 Batch 3:  Loss:     0.1427 Validation Accuracy: 0.882600
Epoch 41, CIFAR-10 Batch 4:  Loss:     0.1396 Validation Accuracy: 0.872600
Epoch 41, CIFAR-10 Batch 5:  Loss:     0.1913 Validation Accuracy: 0.875000
Epoch 41, CIFAR-10 Batch 6:  Loss:     0.3160 Validation Accuracy: 0.871000
Epoch 41, CIFAR-10 Batch 7:  Loss:     0.1566 Validation Accuracy: 0.860600
Epoch 41, CIFAR-10 Batch 8:  Loss:     0.2377 Validation Accuracy: 0.872000
Epoch 41, CIFAR-10 Batch 9:  Loss:     0.1801 Validation Accuracy: 0.877200
Epoch 41, CIFAR-10 Batch 10:  Loss:     0.1409 Validation Accuracy: 0.881600
Epoch 41, CIFAR-10 Batch 11:  Loss:     0.1555 Validation Accuracy: 0.871200
Epoch 41, CIFAR-10 Batch 12:  Loss:     0.2297 Validation Accuracy: 0.877800
Epoch 41, CIFAR-10 Batch 13:  Loss:     0.1852 Validation Accuracy: 0.881200
Epoch 41, CIFAR-10 Batch 14:  Loss:     0.2219 Validation Accuracy: 0.872600
Epoch 41, CIFAR-10 Batch 15:  Loss:     0.1733 Validation Accuracy: 0.864400
Epoch 41, CIFAR-10 Batch 16:  Loss:     0.1693 Validation Accuracy: 0.865000
Epoch 41, CIFAR-10 Batch 17:  Loss:     0.2569 Validation Accuracy: 0.872000
Epoch 41, CIFAR-10 Batch 18:  Loss:     0.1641 Validation Accuracy: 0.878800
Epoch 41, CIFAR-10 Batch 19:  Loss:     0.1466 Validation Accuracy: 0.864600
Epoch 41, CIFAR-10 Batch 20:  Loss:     0.3099 Validation Accuracy: 0.872000
Epoch 41, CIFAR-10 Batch 21:  Loss:     0.1744 Validation Accuracy: 0.871200
Epoch 41, CIFAR-10 Batch 22:  Loss:     0.1912 Validation Accuracy: 0.878400
Epoch 41, CIFAR-10 Batch 23:  Loss:     0.2042 Validation Accuracy: 0.876200
Epoch 41, CIFAR-10 Batch 24:  Loss:     0.2032 Validation Accuracy: 0.875200
Epoch 41, CIFAR-10 Batch 25:  Loss:     0.2373 Validation Accuracy: 0.854600
Epoch 41, CIFAR-10 Batch 26:  Loss:     0.1980 Validation Accuracy: 0.880600
Epoch 41, CIFAR-10 Batch 27:  Loss:     0.1407 Validation Accuracy: 0.876800
Epoch 41, CIFAR-10 Batch 28:  Loss:     0.2427 Validation Accuracy: 0.882400
Epoch 41, CIFAR-10 Batch 29:  Loss:     0.1498 Validation Accuracy: 0.877200
Epoch 41, CIFAR-10 Batch 30:  Loss:     0.1429 Validation Accuracy: 0.877600
Epoch 41, CIFAR-10 Batch 31:  Loss:     0.1740 Validation Accuracy: 0.881200
Epoch 41, CIFAR-10 Batch 32:  Loss:     0.1581 Validation Accuracy: 0.869800
Epoch 41, CIFAR-10 Batch 33:  Loss:     0.3010 Validation Accuracy: 0.868600
Epoch 41, CIFAR-10 Batch 34:  Loss:     0.3150 Validation Accuracy: 0.864600
Epoch 41, CIFAR-10 Batch 35:  Loss:     0.2557 Validation Accuracy: 0.874400
Epoch 41, CIFAR-10 Batch 36:  Loss:     0.2420 Validation Accuracy: 0.871400
Epoch 41, CIFAR-10 Batch 37:  Loss:     0.1532 Validation Accuracy: 0.876400
Epoch 41, CIFAR-10 Batch 38:  Loss:     0.1445 Validation Accuracy: 0.877600
Epoch 41, CIFAR-10 Batch 39:  Loss:     0.1535 Validation Accuracy: 0.876600
Epoch 41, CIFAR-10 Batch 40:  Loss:     0.2664 Validation Accuracy: 0.870200
Epoch 41, CIFAR-10 Batch 41:  Loss:     0.2210 Validation Accuracy: 0.873800
Epoch 41, CIFAR-10 Batch 42:  Loss:     0.2024 Validation Accuracy: 0.864200
Epoch 41, CIFAR-10 Batch 43:  Loss:     0.2515 Validation Accuracy: 0.879600
Epoch 41, CIFAR-10 Batch 44:  Loss:     0.2507 Validation Accuracy: 0.869000
Epoch 41, CIFAR-10 Batch 45:  Loss:     0.1964 Validation Accuracy: 0.869000
Epoch 41, CIFAR-10 Batch 46:  Loss:     0.2495 Validation Accuracy: 0.863600
Epoch 41, CIFAR-10 Batch 47:  Loss:     0.1954 Validation Accuracy: 0.875600
Epoch 41, CIFAR-10 Batch 48:  Loss:     0.1748 Validation Accuracy: 0.876400
Epoch 41, CIFAR-10 Batch 49:  Loss:     0.2595 Validation Accuracy: 0.887200
Epoch 41, CIFAR-10 Batch 50:  Loss:     0.1694 Validation Accuracy: 0.881000
Epoch 42, CIFAR-10 Batch 1:  Loss:     0.1754 Validation Accuracy: 0.867600
Epoch 42, CIFAR-10 Batch 2:  Loss:     0.1837 Validation Accuracy: 0.865800
Epoch 42, CIFAR-10 Batch 3:  Loss:     0.1876 Validation Accuracy: 0.874000
Epoch 42, CIFAR-10 Batch 4:  Loss:     0.1671 Validation Accuracy: 0.862600
Epoch 42, CIFAR-10 Batch 5:  Loss:     0.1818 Validation Accuracy: 0.876400
Epoch 42, CIFAR-10 Batch 6:  Loss:     0.2784 Validation Accuracy: 0.842600
Epoch 42, CIFAR-10 Batch 7:  Loss:     0.1805 Validation Accuracy: 0.868800
Epoch 42, CIFAR-10 Batch 8:  Loss:     0.2596 Validation Accuracy: 0.879400
Epoch 42, CIFAR-10 Batch 9:  Loss:     0.2008 Validation Accuracy: 0.881000
Epoch 42, CIFAR-10 Batch 10:  Loss:     0.1566 Validation Accuracy: 0.861400
Epoch 42, CIFAR-10 Batch 11:  Loss:     0.1877 Validation Accuracy: 0.877400
Epoch 42, CIFAR-10 Batch 12:  Loss:     0.2060 Validation Accuracy: 0.877400
Epoch 42, CIFAR-10 Batch 13:  Loss:     0.2057 Validation Accuracy: 0.872200
Epoch 42, CIFAR-10 Batch 14:  Loss:     0.1958 Validation Accuracy: 0.876600
Epoch 42, CIFAR-10 Batch 15:  Loss:     0.1545 Validation Accuracy: 0.871200
Epoch 42, CIFAR-10 Batch 16:  Loss:     0.1777 Validation Accuracy: 0.863800
Epoch 42, CIFAR-10 Batch 17:  Loss:     0.2242 Validation Accuracy: 0.866800
Epoch 42, CIFAR-10 Batch 18:  Loss:     0.1893 Validation Accuracy: 0.862800
Epoch 42, CIFAR-10 Batch 19:  Loss:     0.1564 Validation Accuracy: 0.878800
Epoch 42, CIFAR-10 Batch 20:  Loss:     0.2813 Validation Accuracy: 0.877200
Epoch 42, CIFAR-10 Batch 21:  Loss:     0.1496 Validation Accuracy: 0.874200
Epoch 42, CIFAR-10 Batch 22:  Loss:     0.1851 Validation Accuracy: 0.876400
Epoch 42, CIFAR-10 Batch 23:  Loss:     0.2083 Validation Accuracy: 0.868400
Epoch 42, CIFAR-10 Batch 24:  Loss:     0.1789 Validation Accuracy: 0.881600
Epoch 42, CIFAR-10 Batch 25:  Loss:     0.2553 Validation Accuracy: 0.871200
Epoch 42, CIFAR-10 Batch 26:  Loss:     0.1814 Validation Accuracy: 0.875800
Epoch 42, CIFAR-10 Batch 27:  Loss:     0.1399 Validation Accuracy: 0.877400
Epoch 42, CIFAR-10 Batch 28:  Loss:     0.3144 Validation Accuracy: 0.881200
Epoch 42, CIFAR-10 Batch 29:  Loss:     0.1606 Validation Accuracy: 0.881200
Epoch 42, CIFAR-10 Batch 30:  Loss:     0.1556 Validation Accuracy: 0.882600
Epoch 42, CIFAR-10 Batch 31:  Loss:     0.1775 Validation Accuracy: 0.876200
Epoch 42, CIFAR-10 Batch 32:  Loss:     0.1426 Validation Accuracy: 0.860400
Epoch 42, CIFAR-10 Batch 33:  Loss:     0.2577 Validation Accuracy: 0.880400
Epoch 42, CIFAR-10 Batch 34:  Loss:     0.3132 Validation Accuracy: 0.874800
Epoch 42, CIFAR-10 Batch 35:  Loss:     0.2281 Validation Accuracy: 0.872000
Epoch 42, CIFAR-10 Batch 36:  Loss:     0.2495 Validation Accuracy: 0.866600
Epoch 42, CIFAR-10 Batch 37:  Loss:     0.1864 Validation Accuracy: 0.871400
Epoch 42, CIFAR-10 Batch 38:  Loss:     0.1500 Validation Accuracy: 0.861600
Epoch 42, CIFAR-10 Batch 39:  Loss:     0.1433 Validation Accuracy: 0.876000
Epoch 42, CIFAR-10 Batch 40:  Loss:     0.2245 Validation Accuracy: 0.875600
Epoch 42, CIFAR-10 Batch 41:  Loss:     0.1814 Validation Accuracy: 0.882400
Epoch 42, CIFAR-10 Batch 42:  Loss:     0.2173 Validation Accuracy: 0.867600
Epoch 42, CIFAR-10 Batch 43:  Loss:     0.2997 Validation Accuracy: 0.876000
Epoch 42, CIFAR-10 Batch 44:  Loss:     0.2393 Validation Accuracy: 0.878200
Epoch 42, CIFAR-10 Batch 45:  Loss:     0.1788 Validation Accuracy: 0.882400
Epoch 42, CIFAR-10 Batch 46:  Loss:     0.2473 Validation Accuracy: 0.883800
Epoch 42, CIFAR-10 Batch 47:  Loss:     0.1808 Validation Accuracy: 0.881800
Epoch 42, CIFAR-10 Batch 48:  Loss:     0.1618 Validation Accuracy: 0.887400
Epoch 42, CIFAR-10 Batch 49:  Loss:     0.2575 Validation Accuracy: 0.880000
Epoch 42, CIFAR-10 Batch 50:  Loss:     0.1775 Validation Accuracy: 0.881400
Epoch 43, CIFAR-10 Batch 1:  Loss:     0.1649 Validation Accuracy: 0.881600
Epoch 43, CIFAR-10 Batch 2:  Loss:     0.1551 Validation Accuracy: 0.873000
Epoch 43, CIFAR-10 Batch 3:  Loss:     0.1944 Validation Accuracy: 0.881600
Epoch 43, CIFAR-10 Batch 4:  Loss:     0.1408 Validation Accuracy: 0.869600
Epoch 43, CIFAR-10 Batch 5:  Loss:     0.1976 Validation Accuracy: 0.874400
Epoch 43, CIFAR-10 Batch 6:  Loss:     0.3583 Validation Accuracy: 0.881400
Epoch 43, CIFAR-10 Batch 7:  Loss:     0.1560 Validation Accuracy: 0.866800
Epoch 43, CIFAR-10 Batch 8:  Loss:     0.2361 Validation Accuracy: 0.875800
Epoch 43, CIFAR-10 Batch 9:  Loss:     0.2479 Validation Accuracy: 0.872800
Epoch 43, CIFAR-10 Batch 10:  Loss:     0.1323 Validation Accuracy: 0.876200
Epoch 43, CIFAR-10 Batch 11:  Loss:     0.1671 Validation Accuracy: 0.874000
Epoch 43, CIFAR-10 Batch 12:  Loss:     0.1950 Validation Accuracy: 0.884600
Epoch 43, CIFAR-10 Batch 13:  Loss:     0.2093 Validation Accuracy: 0.879400
Epoch 43, CIFAR-10 Batch 14:  Loss:     0.2047 Validation Accuracy: 0.866400
Epoch 43, CIFAR-10 Batch 15:  Loss:     0.2132 Validation Accuracy: 0.871800
Epoch 43, CIFAR-10 Batch 16:  Loss:     0.1834 Validation Accuracy: 0.880000
Epoch 43, CIFAR-10 Batch 17:  Loss:     0.2543 Validation Accuracy: 0.876000
Epoch 43, CIFAR-10 Batch 18:  Loss:     0.1412 Validation Accuracy: 0.856200
Epoch 43, CIFAR-10 Batch 19:  Loss:     0.1372 Validation Accuracy: 0.877400
Epoch 43, CIFAR-10 Batch 20:  Loss:     0.2553 Validation Accuracy: 0.876800
Epoch 43, CIFAR-10 Batch 21:  Loss:     0.1483 Validation Accuracy: 0.872600
Epoch 43, CIFAR-10 Batch 22:  Loss:     0.2041 Validation Accuracy: 0.861600
Epoch 43, CIFAR-10 Batch 23:  Loss:     0.2339 Validation Accuracy: 0.869800
Epoch 43, CIFAR-10 Batch 24:  Loss:     0.1865 Validation Accuracy: 0.884000
Epoch 43, CIFAR-10 Batch 25:  Loss:     0.2321 Validation Accuracy: 0.866000
Epoch 43, CIFAR-10 Batch 26:  Loss:     0.1737 Validation Accuracy: 0.879200
Epoch 43, CIFAR-10 Batch 27:  Loss:     0.1404 Validation Accuracy: 0.878200
Epoch 43, CIFAR-10 Batch 28:  Loss:     0.2888 Validation Accuracy: 0.879600
Epoch 43, CIFAR-10 Batch 29:  Loss:     0.1632 Validation Accuracy: 0.871000
Epoch 43, CIFAR-10 Batch 30:  Loss:     0.1355 Validation Accuracy: 0.875600
Epoch 43, CIFAR-10 Batch 31:  Loss:     0.1804 Validation Accuracy: 0.878800
Epoch 43, CIFAR-10 Batch 32:  Loss:     0.1503 Validation Accuracy: 0.878400
Epoch 43, CIFAR-10 Batch 33:  Loss:     0.2224 Validation Accuracy: 0.875800
Epoch 43, CIFAR-10 Batch 34:  Loss:     0.3021 Validation Accuracy: 0.874200
Epoch 43, CIFAR-10 Batch 35:  Loss:     0.2469 Validation Accuracy: 0.866000
Epoch 43, CIFAR-10 Batch 36:  Loss:     0.2425 Validation Accuracy: 0.873000
Epoch 43, CIFAR-10 Batch 37:  Loss:     0.1672 Validation Accuracy: 0.881800
Epoch 43, CIFAR-10 Batch 38:  Loss:     0.1343 Validation Accuracy: 0.869400
Epoch 43, CIFAR-10 Batch 39:  Loss:     0.1440 Validation Accuracy: 0.870600
Epoch 43, CIFAR-10 Batch 40:  Loss:     0.2213 Validation Accuracy: 0.872800
Epoch 43, CIFAR-10 Batch 41:  Loss:     0.2109 Validation Accuracy: 0.873600
Epoch 43, CIFAR-10 Batch 42:  Loss:     0.1805 Validation Accuracy: 0.882000
Epoch 43, CIFAR-10 Batch 43:  Loss:     0.2360 Validation Accuracy: 0.877600
Epoch 43, CIFAR-10 Batch 44:  Loss:     0.2225 Validation Accuracy: 0.869800
Epoch 43, CIFAR-10 Batch 45:  Loss:     0.1653 Validation Accuracy: 0.863400
Epoch 43, CIFAR-10 Batch 46:  Loss:     0.1947 Validation Accuracy: 0.884600
Epoch 43, CIFAR-10 Batch 47:  Loss:     0.1741 Validation Accuracy: 0.880800
Epoch 43, CIFAR-10 Batch 48:  Loss:     0.2265 Validation Accuracy: 0.877600
Epoch 43, CIFAR-10 Batch 49:  Loss:     0.2891 Validation Accuracy: 0.885600
Epoch 43, CIFAR-10 Batch 50:  Loss:     0.1958 Validation Accuracy: 0.882600
Epoch 44, CIFAR-10 Batch 1:  Loss:     0.1628 Validation Accuracy: 0.872600
Epoch 44, CIFAR-10 Batch 2:  Loss:     0.1682 Validation Accuracy: 0.859000
Epoch 44, CIFAR-10 Batch 3:  Loss:     0.1370 Validation Accuracy: 0.881600
Epoch 44, CIFAR-10 Batch 4:  Loss:     0.1752 Validation Accuracy: 0.881400
Epoch 44, CIFAR-10 Batch 5:  Loss:     0.2025 Validation Accuracy: 0.882600
Epoch 44, CIFAR-10 Batch 6:  Loss:     0.3603 Validation Accuracy: 0.879000
Epoch 44, CIFAR-10 Batch 7:  Loss:     0.1741 Validation Accuracy: 0.851600
Epoch 44, CIFAR-10 Batch 8:  Loss:     0.2422 Validation Accuracy: 0.890400
Epoch 44, CIFAR-10 Batch 9:  Loss:     0.2133 Validation Accuracy: 0.883800
Epoch 44, CIFAR-10 Batch 10:  Loss:     0.1436 Validation Accuracy: 0.868400
Epoch 44, CIFAR-10 Batch 11:  Loss:     0.1582 Validation Accuracy: 0.880800
Epoch 44, CIFAR-10 Batch 12:  Loss:     0.2430 Validation Accuracy: 0.872800
Epoch 44, CIFAR-10 Batch 13:  Loss:     0.1985 Validation Accuracy: 0.861600
Epoch 44, CIFAR-10 Batch 14:  Loss:     0.1788 Validation Accuracy: 0.859200
Epoch 44, CIFAR-10 Batch 15:  Loss:     0.1696 Validation Accuracy: 0.861200
Epoch 44, CIFAR-10 Batch 16:  Loss:     0.1830 Validation Accuracy: 0.857200
Epoch 44, CIFAR-10 Batch 17:  Loss:     0.2308 Validation Accuracy: 0.883200
Epoch 44, CIFAR-10 Batch 18:  Loss:     0.1524 Validation Accuracy: 0.864200
Epoch 44, CIFAR-10 Batch 19:  Loss:     0.1565 Validation Accuracy: 0.863400
Epoch 44, CIFAR-10 Batch 20:  Loss:     0.2167 Validation Accuracy: 0.872600
Epoch 44, CIFAR-10 Batch 21:  Loss:     0.1437 Validation Accuracy: 0.887000
Epoch 44, CIFAR-10 Batch 22:  Loss:     0.1913 Validation Accuracy: 0.873400
Epoch 44, CIFAR-10 Batch 23:  Loss:     0.2215 Validation Accuracy: 0.867000
Epoch 44, CIFAR-10 Batch 24:  Loss:     0.2053 Validation Accuracy: 0.893000
Epoch 44, CIFAR-10 Batch 25:  Loss:     0.2462 Validation Accuracy: 0.873000
Epoch 44, CIFAR-10 Batch 26:  Loss:     0.1674 Validation Accuracy: 0.873200
Epoch 44, CIFAR-10 Batch 27:  Loss:     0.1338 Validation Accuracy: 0.859000
Epoch 44, CIFAR-10 Batch 28:  Loss:     0.2833 Validation Accuracy: 0.871000
Epoch 44, CIFAR-10 Batch 29:  Loss:     0.1888 Validation Accuracy: 0.870600
Epoch 44, CIFAR-10 Batch 30:  Loss:     0.1567 Validation Accuracy: 0.883000
Epoch 44, CIFAR-10 Batch 31:  Loss:     0.1745 Validation Accuracy: 0.875600
Epoch 44, CIFAR-10 Batch 32:  Loss:     0.1408 Validation Accuracy: 0.881800
Epoch 44, CIFAR-10 Batch 33:  Loss:     0.2677 Validation Accuracy: 0.869800
Epoch 44, CIFAR-10 Batch 34:  Loss:     0.3393 Validation Accuracy: 0.873600
Epoch 44, CIFAR-10 Batch 35:  Loss:     0.2648 Validation Accuracy: 0.873600
Epoch 44, CIFAR-10 Batch 36:  Loss:     0.2757 Validation Accuracy: 0.864200
Epoch 44, CIFAR-10 Batch 37:  Loss:     0.1698 Validation Accuracy: 0.870200
Epoch 44, CIFAR-10 Batch 38:  Loss:     0.1509 Validation Accuracy: 0.881000
Epoch 44, CIFAR-10 Batch 39:  Loss:     0.1323 Validation Accuracy: 0.861400
Epoch 44, CIFAR-10 Batch 40:  Loss:     0.2151 Validation Accuracy: 0.850800
Epoch 44, CIFAR-10 Batch 41:  Loss:     0.1846 Validation Accuracy: 0.868400
Epoch 44, CIFAR-10 Batch 42:  Loss:     0.1903 Validation Accuracy: 0.872800
Epoch 44, CIFAR-10 Batch 43:  Loss:     0.2368 Validation Accuracy: 0.876200
Epoch 44, CIFAR-10 Batch 44:  Loss:     0.1922 Validation Accuracy: 0.867000
Epoch 44, CIFAR-10 Batch 45:  Loss:     0.1497 Validation Accuracy: 0.876600
Epoch 44, CIFAR-10 Batch 46:  Loss:     0.1928 Validation Accuracy: 0.863000
Epoch 44, CIFAR-10 Batch 47:  Loss:     0.2053 Validation Accuracy: 0.880000
Epoch 44, CIFAR-10 Batch 48:  Loss:     0.2001 Validation Accuracy: 0.884200
Epoch 44, CIFAR-10 Batch 49:  Loss:     0.2777 Validation Accuracy: 0.868000
Epoch 44, CIFAR-10 Batch 50:  Loss:     0.1665 Validation Accuracy: 0.873200
Epoch 45, CIFAR-10 Batch 1:  Loss:     0.1597 Validation Accuracy: 0.873000
Epoch 45, CIFAR-10 Batch 2:  Loss:     0.2262 Validation Accuracy: 0.875000
Epoch 45, CIFAR-10 Batch 3:  Loss:     0.1468 Validation Accuracy: 0.887800
Epoch 45, CIFAR-10 Batch 4:  Loss:     0.1585 Validation Accuracy: 0.872400
Epoch 45, CIFAR-10 Batch 5:  Loss:     0.1860 Validation Accuracy: 0.873400
Epoch 45, CIFAR-10 Batch 6:  Loss:     0.3102 Validation Accuracy: 0.871400
Epoch 45, CIFAR-10 Batch 7:  Loss:     0.1720 Validation Accuracy: 0.871600
Epoch 45, CIFAR-10 Batch 8:  Loss:     0.2303 Validation Accuracy: 0.887600
Epoch 45, CIFAR-10 Batch 9:  Loss:     0.1862 Validation Accuracy: 0.873600
Epoch 45, CIFAR-10 Batch 10:  Loss:     0.1303 Validation Accuracy: 0.855200
Epoch 45, CIFAR-10 Batch 11:  Loss:     0.1762 Validation Accuracy: 0.884800
Epoch 45, CIFAR-10 Batch 12:  Loss:     0.2254 Validation Accuracy: 0.880600
Epoch 45, CIFAR-10 Batch 13:  Loss:     0.2506 Validation Accuracy: 0.879800
Epoch 45, CIFAR-10 Batch 14:  Loss:     0.1802 Validation Accuracy: 0.866200
Epoch 45, CIFAR-10 Batch 15:  Loss:     0.1780 Validation Accuracy: 0.868400
Epoch 45, CIFAR-10 Batch 16:  Loss:     0.1606 Validation Accuracy: 0.865800
Epoch 45, CIFAR-10 Batch 17:  Loss:     0.2153 Validation Accuracy: 0.866600
Epoch 45, CIFAR-10 Batch 18:  Loss:     0.1676 Validation Accuracy: 0.877400
Epoch 45, CIFAR-10 Batch 19:  Loss:     0.1523 Validation Accuracy: 0.875000
Epoch 45, CIFAR-10 Batch 20:  Loss:     0.2738 Validation Accuracy: 0.848000
Epoch 45, CIFAR-10 Batch 21:  Loss:     0.1425 Validation Accuracy: 0.874600
Epoch 45, CIFAR-10 Batch 22:  Loss:     0.1863 Validation Accuracy: 0.882600
Epoch 45, CIFAR-10 Batch 23:  Loss:     0.1874 Validation Accuracy: 0.882000
Epoch 45, CIFAR-10 Batch 24:  Loss:     0.2520 Validation Accuracy: 0.881400
Epoch 45, CIFAR-10 Batch 25:  Loss:     0.2350 Validation Accuracy: 0.868000
Epoch 45, CIFAR-10 Batch 26:  Loss:     0.1656 Validation Accuracy: 0.879600
Epoch 45, CIFAR-10 Batch 27:  Loss:     0.1411 Validation Accuracy: 0.875600
Epoch 45, CIFAR-10 Batch 28:  Loss:     0.3250 Validation Accuracy: 0.871400
Epoch 45, CIFAR-10 Batch 29:  Loss:     0.2024 Validation Accuracy: 0.877800
Epoch 45, CIFAR-10 Batch 30:  Loss:     0.1383 Validation Accuracy: 0.864400
Epoch 45, CIFAR-10 Batch 31:  Loss:     0.1663 Validation Accuracy: 0.871200
Epoch 45, CIFAR-10 Batch 32:  Loss:     0.1393 Validation Accuracy: 0.866800
Epoch 45, CIFAR-10 Batch 33:  Loss:     0.2569 Validation Accuracy: 0.870600
Epoch 45, CIFAR-10 Batch 34:  Loss:     0.3264 Validation Accuracy: 0.874200
Epoch 45, CIFAR-10 Batch 35:  Loss:     0.2785 Validation Accuracy: 0.880400
Epoch 45, CIFAR-10 Batch 36:  Loss:     0.2419 Validation Accuracy: 0.875200
Epoch 45, CIFAR-10 Batch 37:  Loss:     0.1608 Validation Accuracy: 0.874200
Epoch 45, CIFAR-10 Batch 38:  Loss:     0.1409 Validation Accuracy: 0.867800
Epoch 45, CIFAR-10 Batch 39:  Loss:     0.1378 Validation Accuracy: 0.878600
Epoch 45, CIFAR-10 Batch 40:  Loss:     0.2115 Validation Accuracy: 0.856600
Epoch 45, CIFAR-10 Batch 41:  Loss:     0.1901 Validation Accuracy: 0.862200
Epoch 45, CIFAR-10 Batch 42:  Loss:     0.1860 Validation Accuracy: 0.876800
Epoch 45, CIFAR-10 Batch 43:  Loss:     0.2746 Validation Accuracy: 0.876200
Epoch 45, CIFAR-10 Batch 44:  Loss:     0.2136 Validation Accuracy: 0.872600
Epoch 45, CIFAR-10 Batch 45:  Loss:     0.1679 Validation Accuracy: 0.881400
Epoch 45, CIFAR-10 Batch 46:  Loss:     0.2827 Validation Accuracy: 0.869000
Epoch 45, CIFAR-10 Batch 47:  Loss:     0.1970 Validation Accuracy: 0.870000
Epoch 45, CIFAR-10 Batch 48:  Loss:     0.1700 Validation Accuracy: 0.863600
Epoch 45, CIFAR-10 Batch 49:  Loss:     0.2261 Validation Accuracy: 0.874400
Epoch 45, CIFAR-10 Batch 50:  Loss:     0.1791 Validation Accuracy: 0.881600
Epoch 46, CIFAR-10 Batch 1:  Loss:     0.1631 Validation Accuracy: 0.876600
Epoch 46, CIFAR-10 Batch 2:  Loss:     0.2182 Validation Accuracy: 0.871200
Epoch 46, CIFAR-10 Batch 3:  Loss:     0.1431 Validation Accuracy: 0.877400
Epoch 46, CIFAR-10 Batch 4:  Loss:     0.1554 Validation Accuracy: 0.881200
Epoch 46, CIFAR-10 Batch 5:  Loss:     0.1971 Validation Accuracy: 0.874800
Epoch 46, CIFAR-10 Batch 6:  Loss:     0.3014 Validation Accuracy: 0.878800
Epoch 46, CIFAR-10 Batch 7:  Loss:     0.1464 Validation Accuracy: 0.874000
Epoch 46, CIFAR-10 Batch 8:  Loss:     0.2827 Validation Accuracy: 0.871400
Epoch 46, CIFAR-10 Batch 9:  Loss:     0.1926 Validation Accuracy: 0.876000
Epoch 46, CIFAR-10 Batch 10:  Loss:     0.1350 Validation Accuracy: 0.876800
Epoch 46, CIFAR-10 Batch 11:  Loss:     0.1614 Validation Accuracy: 0.882400
Epoch 46, CIFAR-10 Batch 12:  Loss:     0.2352 Validation Accuracy: 0.881600
Epoch 46, CIFAR-10 Batch 13:  Loss:     0.1844 Validation Accuracy: 0.876400
Epoch 46, CIFAR-10 Batch 14:  Loss:     0.2133 Validation Accuracy: 0.867600
Epoch 46, CIFAR-10 Batch 15:  Loss:     0.1606 Validation Accuracy: 0.873600
Epoch 46, CIFAR-10 Batch 16:  Loss:     0.1666 Validation Accuracy: 0.880000
Epoch 46, CIFAR-10 Batch 17:  Loss:     0.2015 Validation Accuracy: 0.881800
Epoch 46, CIFAR-10 Batch 18:  Loss:     0.1536 Validation Accuracy: 0.872000
Epoch 46, CIFAR-10 Batch 19:  Loss:     0.1424 Validation Accuracy: 0.871400
Epoch 46, CIFAR-10 Batch 20:  Loss:     0.2553 Validation Accuracy: 0.880000
Epoch 46, CIFAR-10 Batch 21:  Loss:     0.1406 Validation Accuracy: 0.884800
Epoch 46, CIFAR-10 Batch 22:  Loss:     0.1770 Validation Accuracy: 0.882000
Epoch 46, CIFAR-10 Batch 23:  Loss:     0.1923 Validation Accuracy: 0.878600
Epoch 46, CIFAR-10 Batch 24:  Loss:     0.1993 Validation Accuracy: 0.891000
Epoch 46, CIFAR-10 Batch 25:  Loss:     0.1859 Validation Accuracy: 0.886200
Epoch 46, CIFAR-10 Batch 26:  Loss:     0.1688 Validation Accuracy: 0.883600
Epoch 46, CIFAR-10 Batch 27:  Loss:     0.1382 Validation Accuracy: 0.843200
Epoch 46, CIFAR-10 Batch 28:  Loss:     0.2793 Validation Accuracy: 0.882200
Epoch 46, CIFAR-10 Batch 29:  Loss:     0.1695 Validation Accuracy: 0.881800
Epoch 46, CIFAR-10 Batch 30:  Loss:     0.1425 Validation Accuracy: 0.867400
Epoch 46, CIFAR-10 Batch 31:  Loss:     0.1746 Validation Accuracy: 0.882000
Epoch 46, CIFAR-10 Batch 32:  Loss:     0.1490 Validation Accuracy: 0.877000
Epoch 46, CIFAR-10 Batch 33:  Loss:     0.2585 Validation Accuracy: 0.870000
Epoch 46, CIFAR-10 Batch 34:  Loss:     0.2971 Validation Accuracy: 0.877400
Epoch 46, CIFAR-10 Batch 35:  Loss:     0.2629 Validation Accuracy: 0.880800
Epoch 46, CIFAR-10 Batch 36:  Loss:     0.2787 Validation Accuracy: 0.878200
Epoch 46, CIFAR-10 Batch 37:  Loss:     0.1506 Validation Accuracy: 0.883800
Epoch 46, CIFAR-10 Batch 38:  Loss:     0.1476 Validation Accuracy: 0.873000
Epoch 46, CIFAR-10 Batch 39:  Loss:     0.1471 Validation Accuracy: 0.876000
Epoch 46, CIFAR-10 Batch 40:  Loss:     0.2062 Validation Accuracy: 0.847200
Epoch 46, CIFAR-10 Batch 41:  Loss:     0.2246 Validation Accuracy: 0.865800
Epoch 46, CIFAR-10 Batch 42:  Loss:     0.1899 Validation Accuracy: 0.875000
Epoch 46, CIFAR-10 Batch 43:  Loss:     0.3063 Validation Accuracy: 0.878400
Epoch 46, CIFAR-10 Batch 44:  Loss:     0.2058 Validation Accuracy: 0.861200
Epoch 46, CIFAR-10 Batch 45:  Loss:     0.2113 Validation Accuracy: 0.879800
Epoch 46, CIFAR-10 Batch 46:  Loss:     0.1768 Validation Accuracy: 0.879400
Epoch 46, CIFAR-10 Batch 47:  Loss:     0.1675 Validation Accuracy: 0.886000
Epoch 46, CIFAR-10 Batch 48:  Loss:     0.1828 Validation Accuracy: 0.873400
Epoch 46, CIFAR-10 Batch 49:  Loss:     0.2448 Validation Accuracy: 0.875400
Epoch 46, CIFAR-10 Batch 50:  Loss:     0.1749 Validation Accuracy: 0.868400
Epoch 47, CIFAR-10 Batch 1:  Loss:     0.1582 Validation Accuracy: 0.878000
Epoch 47, CIFAR-10 Batch 2:  Loss:     0.2242 Validation Accuracy: 0.872400
Epoch 47, CIFAR-10 Batch 3:  Loss:     0.1453 Validation Accuracy: 0.882400
Epoch 47, CIFAR-10 Batch 4:  Loss:     0.1589 Validation Accuracy: 0.873000
Epoch 47, CIFAR-10 Batch 5:  Loss:     0.1676 Validation Accuracy: 0.879400
Epoch 47, CIFAR-10 Batch 6:  Loss:     0.3683 Validation Accuracy: 0.870200
Epoch 47, CIFAR-10 Batch 7:  Loss:     0.1541 Validation Accuracy: 0.875200
Epoch 47, CIFAR-10 Batch 8:  Loss:     0.2057 Validation Accuracy: 0.876800
Epoch 47, CIFAR-10 Batch 9:  Loss:     0.1656 Validation Accuracy: 0.880600
Epoch 47, CIFAR-10 Batch 10:  Loss:     0.1423 Validation Accuracy: 0.878800
Epoch 47, CIFAR-10 Batch 11:  Loss:     0.1714 Validation Accuracy: 0.875000
Epoch 47, CIFAR-10 Batch 12:  Loss:     0.1935 Validation Accuracy: 0.878800
Epoch 47, CIFAR-10 Batch 13:  Loss:     0.2005 Validation Accuracy: 0.880600
Epoch 47, CIFAR-10 Batch 14:  Loss:     0.1734 Validation Accuracy: 0.871600
Epoch 47, CIFAR-10 Batch 15:  Loss:     0.1690 Validation Accuracy: 0.872200
Epoch 47, CIFAR-10 Batch 16:  Loss:     0.2243 Validation Accuracy: 0.867000
Epoch 47, CIFAR-10 Batch 17:  Loss:     0.2009 Validation Accuracy: 0.888800
Epoch 47, CIFAR-10 Batch 18:  Loss:     0.1430 Validation Accuracy: 0.868600
Epoch 47, CIFAR-10 Batch 19:  Loss:     0.1589 Validation Accuracy: 0.882600
Epoch 47, CIFAR-10 Batch 20:  Loss:     0.2537 Validation Accuracy: 0.867000
Epoch 47, CIFAR-10 Batch 21:  Loss:     0.1460 Validation Accuracy: 0.884400
Epoch 47, CIFAR-10 Batch 22:  Loss:     0.1773 Validation Accuracy: 0.879200
Epoch 47, CIFAR-10 Batch 23:  Loss:     0.1731 Validation Accuracy: 0.864200
Epoch 47, CIFAR-10 Batch 24:  Loss:     0.2333 Validation Accuracy: 0.884800
Epoch 47, CIFAR-10 Batch 25:  Loss:     0.2276 Validation Accuracy: 0.875800
Epoch 47, CIFAR-10 Batch 26:  Loss:     0.1832 Validation Accuracy: 0.883400
Epoch 47, CIFAR-10 Batch 27:  Loss:     0.1348 Validation Accuracy: 0.870200
Epoch 47, CIFAR-10 Batch 28:  Loss:     0.2398 Validation Accuracy: 0.882200
Epoch 47, CIFAR-10 Batch 29:  Loss:     0.1576 Validation Accuracy: 0.876200
Epoch 47, CIFAR-10 Batch 30:  Loss:     0.1584 Validation Accuracy: 0.878800
Epoch 47, CIFAR-10 Batch 31:  Loss:     0.1791 Validation Accuracy: 0.865600
Epoch 47, CIFAR-10 Batch 32:  Loss:     0.1366 Validation Accuracy: 0.870000
Epoch 47, CIFAR-10 Batch 33:  Loss:     0.2554 Validation Accuracy: 0.875200
Epoch 47, CIFAR-10 Batch 34:  Loss:     0.3064 Validation Accuracy: 0.864400
Epoch 47, CIFAR-10 Batch 35:  Loss:     0.2571 Validation Accuracy: 0.875200
Epoch 47, CIFAR-10 Batch 36:  Loss:     0.2896 Validation Accuracy: 0.870400
Epoch 47, CIFAR-10 Batch 37:  Loss:     0.1437 Validation Accuracy: 0.879000
Epoch 47, CIFAR-10 Batch 38:  Loss:     0.1445 Validation Accuracy: 0.876000
Epoch 47, CIFAR-10 Batch 39:  Loss:     0.1523 Validation Accuracy: 0.876000
Epoch 47, CIFAR-10 Batch 40:  Loss:     0.2209 Validation Accuracy: 0.876000
Epoch 47, CIFAR-10 Batch 41:  Loss:     0.2036 Validation Accuracy: 0.881400
Epoch 47, CIFAR-10 Batch 42:  Loss:     0.2090 Validation Accuracy: 0.874600
Epoch 47, CIFAR-10 Batch 43:  Loss:     0.2856 Validation Accuracy: 0.884000
Epoch 47, CIFAR-10 Batch 44:  Loss:     0.1929 Validation Accuracy: 0.851200
Epoch 47, CIFAR-10 Batch 45:  Loss:     0.1572 Validation Accuracy: 0.876200
Epoch 47, CIFAR-10 Batch 46:  Loss:     0.2156 Validation Accuracy: 0.868800
Epoch 47, CIFAR-10 Batch 47:  Loss:     0.1726 Validation Accuracy: 0.886600
Epoch 47, CIFAR-10 Batch 48:  Loss:     0.1833 Validation Accuracy: 0.866000
Epoch 47, CIFAR-10 Batch 49:  Loss:     0.2235 Validation Accuracy: 0.880600
Epoch 47, CIFAR-10 Batch 50:  Loss:     0.1748 Validation Accuracy: 0.880400
Epoch 48, CIFAR-10 Batch 1:  Loss:     0.1471 Validation Accuracy: 0.876000
Epoch 48, CIFAR-10 Batch 2:  Loss:     0.1708 Validation Accuracy: 0.881200
Epoch 48, CIFAR-10 Batch 3:  Loss:     0.1588 Validation Accuracy: 0.885600
Epoch 48, CIFAR-10 Batch 4:  Loss:     0.1633 Validation Accuracy: 0.876000
Epoch 48, CIFAR-10 Batch 5:  Loss:     0.1919 Validation Accuracy: 0.871600
Epoch 48, CIFAR-10 Batch 6:  Loss:     0.2665 Validation Accuracy: 0.889600
Epoch 48, CIFAR-10 Batch 7:  Loss:     0.1458 Validation Accuracy: 0.875400
Epoch 48, CIFAR-10 Batch 8:  Loss:     0.2074 Validation Accuracy: 0.883600
Epoch 48, CIFAR-10 Batch 9:  Loss:     0.1939 Validation Accuracy: 0.884200
Epoch 48, CIFAR-10 Batch 10:  Loss:     0.1340 Validation Accuracy: 0.878800
Epoch 48, CIFAR-10 Batch 11:  Loss:     0.1768 Validation Accuracy: 0.863800
Epoch 48, CIFAR-10 Batch 12:  Loss:     0.1954 Validation Accuracy: 0.869000
Epoch 48, CIFAR-10 Batch 13:  Loss:     0.2228 Validation Accuracy: 0.884400
Epoch 48, CIFAR-10 Batch 14:  Loss:     0.1955 Validation Accuracy: 0.868800
Epoch 48, CIFAR-10 Batch 15:  Loss:     0.1604 Validation Accuracy: 0.886400
Epoch 48, CIFAR-10 Batch 16:  Loss:     0.1753 Validation Accuracy: 0.867600
Epoch 48, CIFAR-10 Batch 17:  Loss:     0.2208 Validation Accuracy: 0.882000
Epoch 48, CIFAR-10 Batch 18:  Loss:     0.1930 Validation Accuracy: 0.866000
Epoch 48, CIFAR-10 Batch 19:  Loss:     0.1407 Validation Accuracy: 0.890200
Epoch 48, CIFAR-10 Batch 20:  Loss:     0.2437 Validation Accuracy: 0.874600
Epoch 48, CIFAR-10 Batch 21:  Loss:     0.1999 Validation Accuracy: 0.866800
Epoch 48, CIFAR-10 Batch 22:  Loss:     0.1956 Validation Accuracy: 0.887000
Epoch 48, CIFAR-10 Batch 23:  Loss:     0.1864 Validation Accuracy: 0.874400
Epoch 48, CIFAR-10 Batch 24:  Loss:     0.2011 Validation Accuracy: 0.880800
Epoch 48, CIFAR-10 Batch 25:  Loss:     0.2606 Validation Accuracy: 0.870600
Epoch 48, CIFAR-10 Batch 26:  Loss:     0.1818 Validation Accuracy: 0.882400
Epoch 48, CIFAR-10 Batch 27:  Loss:     0.1319 Validation Accuracy: 0.869600
Epoch 48, CIFAR-10 Batch 28:  Loss:     0.2599 Validation Accuracy: 0.881200
Epoch 48, CIFAR-10 Batch 29:  Loss:     0.1698 Validation Accuracy: 0.873600
Epoch 48, CIFAR-10 Batch 30:  Loss:     0.1440 Validation Accuracy: 0.866400
Epoch 48, CIFAR-10 Batch 31:  Loss:     0.1859 Validation Accuracy: 0.878400
Epoch 48, CIFAR-10 Batch 32:  Loss:     0.1487 Validation Accuracy: 0.871000
Epoch 48, CIFAR-10 Batch 33:  Loss:     0.2474 Validation Accuracy: 0.874400
Epoch 48, CIFAR-10 Batch 34:  Loss:     0.2698 Validation Accuracy: 0.851400
Epoch 48, CIFAR-10 Batch 35:  Loss:     0.2387 Validation Accuracy: 0.881600
Epoch 48, CIFAR-10 Batch 36:  Loss:     0.2635 Validation Accuracy: 0.880400
Epoch 48, CIFAR-10 Batch 37:  Loss:     0.1692 Validation Accuracy: 0.869600
Epoch 48, CIFAR-10 Batch 38:  Loss:     0.1594 Validation Accuracy: 0.875000
Epoch 48, CIFAR-10 Batch 39:  Loss:     0.1804 Validation Accuracy: 0.878000
Epoch 48, CIFAR-10 Batch 40:  Loss:     0.1966 Validation Accuracy: 0.869800
Epoch 48, CIFAR-10 Batch 41:  Loss:     0.2149 Validation Accuracy: 0.875800
Epoch 48, CIFAR-10 Batch 42:  Loss:     0.1770 Validation Accuracy: 0.881400
Epoch 48, CIFAR-10 Batch 43:  Loss:     0.3016 Validation Accuracy: 0.867800
Epoch 48, CIFAR-10 Batch 44:  Loss:     0.1778 Validation Accuracy: 0.866400
Epoch 48, CIFAR-10 Batch 45:  Loss:     0.1569 Validation Accuracy: 0.881400
Epoch 48, CIFAR-10 Batch 46:  Loss:     0.1808 Validation Accuracy: 0.877000
Epoch 48, CIFAR-10 Batch 47:  Loss:     0.1735 Validation Accuracy: 0.880200
Epoch 48, CIFAR-10 Batch 48:  Loss:     0.2121 Validation Accuracy: 0.882200
Epoch 48, CIFAR-10 Batch 49:  Loss:     0.2156 Validation Accuracy: 0.880000
Epoch 48, CIFAR-10 Batch 50:  Loss:     0.1874 Validation Accuracy: 0.885000
Epoch 49, CIFAR-10 Batch 1:  Loss:     0.1762 Validation Accuracy: 0.870800
Epoch 49, CIFAR-10 Batch 2:  Loss:     0.1971 Validation Accuracy: 0.884200
Epoch 49, CIFAR-10 Batch 3:  Loss:     0.1602 Validation Accuracy: 0.873200
Epoch 49, CIFAR-10 Batch 4:  Loss:     0.1468 Validation Accuracy: 0.854400
Epoch 49, CIFAR-10 Batch 5:  Loss:     0.1883 Validation Accuracy: 0.873200
Epoch 49, CIFAR-10 Batch 6:  Loss:     0.2798 Validation Accuracy: 0.876400
Epoch 49, CIFAR-10 Batch 7:  Loss:     0.1436 Validation Accuracy: 0.878600
Epoch 49, CIFAR-10 Batch 8:  Loss:     0.2418 Validation Accuracy: 0.878000
Epoch 49, CIFAR-10 Batch 9:  Loss:     0.1587 Validation Accuracy: 0.873600
Epoch 49, CIFAR-10 Batch 10:  Loss:     0.1690 Validation Accuracy: 0.882600
Epoch 49, CIFAR-10 Batch 11:  Loss:     0.2019 Validation Accuracy: 0.886000
Epoch 49, CIFAR-10 Batch 12:  Loss:     0.1669 Validation Accuracy: 0.880400
Epoch 49, CIFAR-10 Batch 13:  Loss:     0.1819 Validation Accuracy: 0.871800
Epoch 49, CIFAR-10 Batch 14:  Loss:     0.2135 Validation Accuracy: 0.847800
Epoch 49, CIFAR-10 Batch 15:  Loss:     0.1874 Validation Accuracy: 0.866400
Epoch 49, CIFAR-10 Batch 16:  Loss:     0.1691 Validation Accuracy: 0.876800
Epoch 49, CIFAR-10 Batch 17:  Loss:     0.2379 Validation Accuracy: 0.877400
Epoch 49, CIFAR-10 Batch 18:  Loss:     0.1794 Validation Accuracy: 0.871000
Epoch 49, CIFAR-10 Batch 19:  Loss:     0.1421 Validation Accuracy: 0.878600
Epoch 49, CIFAR-10 Batch 20:  Loss:     0.2695 Validation Accuracy: 0.869600
Epoch 49, CIFAR-10 Batch 21:  Loss:     0.1460 Validation Accuracy: 0.876600
Epoch 49, CIFAR-10 Batch 22:  Loss:     0.1826 Validation Accuracy: 0.876800
Epoch 49, CIFAR-10 Batch 23:  Loss:     0.1630 Validation Accuracy: 0.878800
Epoch 49, CIFAR-10 Batch 24:  Loss:     0.2185 Validation Accuracy: 0.883400
Epoch 49, CIFAR-10 Batch 25:  Loss:     0.2297 Validation Accuracy: 0.878600
Epoch 49, CIFAR-10 Batch 26:  Loss:     0.1547 Validation Accuracy: 0.889200
Epoch 49, CIFAR-10 Batch 27:  Loss:     0.1347 Validation Accuracy: 0.874600
Epoch 49, CIFAR-10 Batch 28:  Loss:     0.2701 Validation Accuracy: 0.882400
Epoch 49, CIFAR-10 Batch 29:  Loss:     0.1500 Validation Accuracy: 0.869000
Epoch 49, CIFAR-10 Batch 30:  Loss:     0.1450 Validation Accuracy: 0.878800
Epoch 49, CIFAR-10 Batch 31:  Loss:     0.1682 Validation Accuracy: 0.880400
Epoch 49, CIFAR-10 Batch 32:  Loss:     0.1765 Validation Accuracy: 0.880200
Epoch 49, CIFAR-10 Batch 33:  Loss:     0.2510 Validation Accuracy: 0.867600
Epoch 49, CIFAR-10 Batch 34:  Loss:     0.2919 Validation Accuracy: 0.856600
Epoch 49, CIFAR-10 Batch 35:  Loss:     0.2661 Validation Accuracy: 0.877400
Epoch 49, CIFAR-10 Batch 36:  Loss:     0.2587 Validation Accuracy: 0.871200
Epoch 49, CIFAR-10 Batch 37:  Loss:     0.1419 Validation Accuracy: 0.879600
Epoch 49, CIFAR-10 Batch 38:  Loss:     0.1498 Validation Accuracy: 0.877400
Epoch 49, CIFAR-10 Batch 39:  Loss:     0.1448 Validation Accuracy: 0.886400
Epoch 49, CIFAR-10 Batch 40:  Loss:     0.1797 Validation Accuracy: 0.854600
Epoch 49, CIFAR-10 Batch 41:  Loss:     0.2223 Validation Accuracy: 0.878200
Epoch 49, CIFAR-10 Batch 42:  Loss:     0.1942 Validation Accuracy: 0.874000
Epoch 49, CIFAR-10 Batch 43:  Loss:     0.2675 Validation Accuracy: 0.883200
Epoch 49, CIFAR-10 Batch 44:  Loss:     0.2030 Validation Accuracy: 0.868000
Epoch 49, CIFAR-10 Batch 45:  Loss:     0.1611 Validation Accuracy: 0.872400
Epoch 49, CIFAR-10 Batch 46:  Loss:     0.2037 Validation Accuracy: 0.872200
Epoch 49, CIFAR-10 Batch 47:  Loss:     0.1686 Validation Accuracy: 0.878800
Epoch 49, CIFAR-10 Batch 48:  Loss:     0.1740 Validation Accuracy: 0.870000
Epoch 49, CIFAR-10 Batch 49:  Loss:     0.2151 Validation Accuracy: 0.883000
Epoch 49, CIFAR-10 Batch 50:  Loss:     0.1920 Validation Accuracy: 0.875000
Epoch 50, CIFAR-10 Batch 1:  Loss:     0.1744 Validation Accuracy: 0.877600
Epoch 50, CIFAR-10 Batch 2:  Loss:     0.1944 Validation Accuracy: 0.875600
Epoch 50, CIFAR-10 Batch 3:  Loss:     0.1504 Validation Accuracy: 0.875600
Epoch 50, CIFAR-10 Batch 4:  Loss:     0.1623 Validation Accuracy: 0.874600
Epoch 50, CIFAR-10 Batch 5:  Loss:     0.1864 Validation Accuracy: 0.882200
Epoch 50, CIFAR-10 Batch 6:  Loss:     0.2341 Validation Accuracy: 0.884200
Epoch 50, CIFAR-10 Batch 7:  Loss:     0.1614 Validation Accuracy: 0.884200
Epoch 50, CIFAR-10 Batch 8:  Loss:     0.1861 Validation Accuracy: 0.879000
Epoch 50, CIFAR-10 Batch 9:  Loss:     0.2039 Validation Accuracy: 0.877000
Epoch 50, CIFAR-10 Batch 10:  Loss:     0.1376 Validation Accuracy: 0.884600
Epoch 50, CIFAR-10 Batch 11:  Loss:     0.2001 Validation Accuracy: 0.883600
Epoch 50, CIFAR-10 Batch 12:  Loss:     0.1646 Validation Accuracy: 0.869600
Epoch 50, CIFAR-10 Batch 13:  Loss:     0.2128 Validation Accuracy: 0.876000
Epoch 50, CIFAR-10 Batch 14:  Loss:     0.2096 Validation Accuracy: 0.846400
Epoch 50, CIFAR-10 Batch 15:  Loss:     0.1768 Validation Accuracy: 0.877200
Epoch 50, CIFAR-10 Batch 16:  Loss:     0.1738 Validation Accuracy: 0.876800
Epoch 50, CIFAR-10 Batch 17:  Loss:     0.2789 Validation Accuracy: 0.879800
Epoch 50, CIFAR-10 Batch 18:  Loss:     0.1512 Validation Accuracy: 0.868000
Epoch 50, CIFAR-10 Batch 19:  Loss:     0.1681 Validation Accuracy: 0.880800
Epoch 50, CIFAR-10 Batch 20:  Loss:     0.2507 Validation Accuracy: 0.882200
Epoch 50, CIFAR-10 Batch 21:  Loss:     0.1915 Validation Accuracy: 0.854000
Epoch 50, CIFAR-10 Batch 22:  Loss:     0.2031 Validation Accuracy: 0.888400
Epoch 50, CIFAR-10 Batch 23:  Loss:     0.1848 Validation Accuracy: 0.876000
Epoch 50, CIFAR-10 Batch 24:  Loss:     0.2121 Validation Accuracy: 0.868400
Epoch 50, CIFAR-10 Batch 25:  Loss:     0.2294 Validation Accuracy: 0.867400
Epoch 50, CIFAR-10 Batch 26:  Loss:     0.1636 Validation Accuracy: 0.882800
Epoch 50, CIFAR-10 Batch 27:  Loss:     0.1449 Validation Accuracy: 0.866600
Epoch 50, CIFAR-10 Batch 28:  Loss:     0.2655 Validation Accuracy: 0.877400
Epoch 50, CIFAR-10 Batch 29:  Loss:     0.1852 Validation Accuracy: 0.874600
Epoch 50, CIFAR-10 Batch 30:  Loss:     0.1378 Validation Accuracy: 0.878000
Epoch 50, CIFAR-10 Batch 31:  Loss:     0.1472 Validation Accuracy: 0.870400
Epoch 50, CIFAR-10 Batch 32:  Loss:     0.1790 Validation Accuracy: 0.880800
Epoch 50, CIFAR-10 Batch 33:  Loss:     0.2140 Validation Accuracy: 0.880600
Epoch 50, CIFAR-10 Batch 34:  Loss:     0.3078 Validation Accuracy: 0.878800
Epoch 50, CIFAR-10 Batch 35:  Loss:     0.2130 Validation Accuracy: 0.889200
Epoch 50, CIFAR-10 Batch 36:  Loss:     0.2828 Validation Accuracy: 0.861000
Epoch 50, CIFAR-10 Batch 37:  Loss:     0.1495 Validation Accuracy: 0.865000
Epoch 50, CIFAR-10 Batch 38:  Loss:     0.1455 Validation Accuracy: 0.877800
Epoch 50, CIFAR-10 Batch 39:  Loss:     0.1492 Validation Accuracy: 0.879600
Epoch 50, CIFAR-10 Batch 40:  Loss:     0.2172 Validation Accuracy: 0.867200
Epoch 50, CIFAR-10 Batch 41:  Loss:     0.1643 Validation Accuracy: 0.871800
Epoch 50, CIFAR-10 Batch 42:  Loss:     0.1802 Validation Accuracy: 0.886800
Epoch 50, CIFAR-10 Batch 43:  Loss:     0.2983 Validation Accuracy: 0.874200
Epoch 50, CIFAR-10 Batch 44:  Loss:     0.1787 Validation Accuracy: 0.873000
Epoch 50, CIFAR-10 Batch 45:  Loss:     0.1606 Validation Accuracy: 0.881200
Epoch 50, CIFAR-10 Batch 46:  Loss:     0.2448 Validation Accuracy: 0.879200
Epoch 50, CIFAR-10 Batch 47:  Loss:     0.1550 Validation Accuracy: 0.887800
Epoch 50, CIFAR-10 Batch 48:  Loss:     0.1861 Validation Accuracy: 0.881000
Epoch 50, CIFAR-10 Batch 49:  Loss:     0.2048 Validation Accuracy: 0.875600
Epoch 50, CIFAR-10 Batch 50:  Loss:     0.1825 Validation Accuracy: 0.870600
Epoch 51, CIFAR-10 Batch 1:  Loss:     0.1620 Validation Accuracy: 0.876400
Epoch 51, CIFAR-10 Batch 2:  Loss:     0.1835 Validation Accuracy: 0.881600
Epoch 51, CIFAR-10 Batch 3:  Loss:     0.1462 Validation Accuracy: 0.875200
Epoch 51, CIFAR-10 Batch 4:  Loss:     0.1731 Validation Accuracy: 0.883800
Epoch 51, CIFAR-10 Batch 5:  Loss:     0.2115 Validation Accuracy: 0.887000
Epoch 51, CIFAR-10 Batch 6:  Loss:     0.2906 Validation Accuracy: 0.879400
Epoch 51, CIFAR-10 Batch 7:  Loss:     0.1480 Validation Accuracy: 0.863200
Epoch 51, CIFAR-10 Batch 8:  Loss:     0.2736 Validation Accuracy: 0.879200
Epoch 51, CIFAR-10 Batch 9:  Loss:     0.1917 Validation Accuracy: 0.877000
Epoch 51, CIFAR-10 Batch 10:  Loss:     0.1303 Validation Accuracy: 0.886200
Epoch 51, CIFAR-10 Batch 11:  Loss:     0.2215 Validation Accuracy: 0.873600
Epoch 51, CIFAR-10 Batch 12:  Loss:     0.2283 Validation Accuracy: 0.864000
Epoch 51, CIFAR-10 Batch 13:  Loss:     0.2184 Validation Accuracy: 0.881000
Epoch 51, CIFAR-10 Batch 14:  Loss:     0.1828 Validation Accuracy: 0.868200
Epoch 51, CIFAR-10 Batch 15:  Loss:     0.1772 Validation Accuracy: 0.881400
Epoch 51, CIFAR-10 Batch 16:  Loss:     0.1986 Validation Accuracy: 0.858000
Epoch 51, CIFAR-10 Batch 17:  Loss:     0.2404 Validation Accuracy: 0.881000
Epoch 51, CIFAR-10 Batch 18:  Loss:     0.1400 Validation Accuracy: 0.873400
Epoch 51, CIFAR-10 Batch 19:  Loss:     0.1441 Validation Accuracy: 0.872400
Epoch 51, CIFAR-10 Batch 20:  Loss:     0.2455 Validation Accuracy: 0.879400
Epoch 51, CIFAR-10 Batch 21:  Loss:     0.1564 Validation Accuracy: 0.882200
Epoch 51, CIFAR-10 Batch 22:  Loss:     0.2056 Validation Accuracy: 0.886600
Epoch 51, CIFAR-10 Batch 23:  Loss:     0.1699 Validation Accuracy: 0.880200
Epoch 51, CIFAR-10 Batch 24:  Loss:     0.1938 Validation Accuracy: 0.874600
Epoch 51, CIFAR-10 Batch 25:  Loss:     0.2176 Validation Accuracy: 0.851800
Epoch 51, CIFAR-10 Batch 26:  Loss:     0.1798 Validation Accuracy: 0.865000
Epoch 51, CIFAR-10 Batch 27:  Loss:     0.1574 Validation Accuracy: 0.872800
Epoch 51, CIFAR-10 Batch 28:  Loss:     0.3185 Validation Accuracy: 0.884000
Epoch 51, CIFAR-10 Batch 29:  Loss:     0.1850 Validation Accuracy: 0.864600
Epoch 51, CIFAR-10 Batch 30:  Loss:     0.1587 Validation Accuracy: 0.880600
Epoch 51, CIFAR-10 Batch 31:  Loss:     0.1550 Validation Accuracy: 0.874600
Epoch 51, CIFAR-10 Batch 32:  Loss:     0.1452 Validation Accuracy: 0.885400
Epoch 51, CIFAR-10 Batch 33:  Loss:     0.2627 Validation Accuracy: 0.879000
Epoch 51, CIFAR-10 Batch 34:  Loss:     0.2468 Validation Accuracy: 0.882000
Epoch 51, CIFAR-10 Batch 35:  Loss:     0.2426 Validation Accuracy: 0.873000
Epoch 51, CIFAR-10 Batch 36:  Loss:     0.2444 Validation Accuracy: 0.871400
Epoch 51, CIFAR-10 Batch 37:  Loss:     0.1571 Validation Accuracy: 0.884000
Epoch 51, CIFAR-10 Batch 38:  Loss:     0.1515 Validation Accuracy: 0.883400
Epoch 51, CIFAR-10 Batch 39:  Loss:     0.1547 Validation Accuracy: 0.878800
Epoch 51, CIFAR-10 Batch 40:  Loss:     0.1850 Validation Accuracy: 0.869400
Epoch 51, CIFAR-10 Batch 41:  Loss:     0.1622 Validation Accuracy: 0.884800
Epoch 51, CIFAR-10 Batch 42:  Loss:     0.2371 Validation Accuracy: 0.878600
Epoch 51, CIFAR-10 Batch 43:  Loss:     0.2854 Validation Accuracy: 0.880800
Epoch 51, CIFAR-10 Batch 44:  Loss:     0.1675 Validation Accuracy: 0.883400
Epoch 51, CIFAR-10 Batch 45:  Loss:     0.1518 Validation Accuracy: 0.885400
Epoch 51, CIFAR-10 Batch 46:  Loss:     0.1855 Validation Accuracy: 0.861600
Epoch 51, CIFAR-10 Batch 47:  Loss:     0.1854 Validation Accuracy: 0.876600
Epoch 51, CIFAR-10 Batch 48:  Loss:     0.1733 Validation Accuracy: 0.857200
Epoch 51, CIFAR-10 Batch 49:  Loss:     0.2208 Validation Accuracy: 0.879200
Epoch 51, CIFAR-10 Batch 50:  Loss:     0.1968 Validation Accuracy: 0.878000
Epoch 52, CIFAR-10 Batch 1:  Loss:     0.1597 Validation Accuracy: 0.872400
Epoch 52, CIFAR-10 Batch 2:  Loss:     0.1540 Validation Accuracy: 0.866800
Epoch 52, CIFAR-10 Batch 3:  Loss:     0.1526 Validation Accuracy: 0.881400
Epoch 52, CIFAR-10 Batch 4:  Loss:     0.1981 Validation Accuracy: 0.873600
Epoch 52, CIFAR-10 Batch 5:  Loss:     0.1546 Validation Accuracy: 0.881400
Epoch 52, CIFAR-10 Batch 6:  Loss:     0.2825 Validation Accuracy: 0.878200
Epoch 52, CIFAR-10 Batch 7:  Loss:     0.1636 Validation Accuracy: 0.875800
Epoch 52, CIFAR-10 Batch 8:  Loss:     0.2940 Validation Accuracy: 0.882600
Epoch 52, CIFAR-10 Batch 9:  Loss:     0.1616 Validation Accuracy: 0.870400
Epoch 52, CIFAR-10 Batch 10:  Loss:     0.1285 Validation Accuracy: 0.882200
Epoch 52, CIFAR-10 Batch 11:  Loss:     0.1446 Validation Accuracy: 0.883600
Epoch 52, CIFAR-10 Batch 12:  Loss:     0.1979 Validation Accuracy: 0.877400
Epoch 52, CIFAR-10 Batch 13:  Loss:     0.1747 Validation Accuracy: 0.867000
Epoch 52, CIFAR-10 Batch 14:  Loss:     0.1853 Validation Accuracy: 0.863000
Epoch 52, CIFAR-10 Batch 15:  Loss:     0.1528 Validation Accuracy: 0.877200
Epoch 52, CIFAR-10 Batch 16:  Loss:     0.1539 Validation Accuracy: 0.874400
Epoch 52, CIFAR-10 Batch 17:  Loss:     0.2201 Validation Accuracy: 0.873600
Epoch 52, CIFAR-10 Batch 18:  Loss:     0.1551 Validation Accuracy: 0.878000
Epoch 52, CIFAR-10 Batch 19:  Loss:     0.1595 Validation Accuracy: 0.874400
Epoch 52, CIFAR-10 Batch 20:  Loss:     0.2067 Validation Accuracy: 0.865200
Epoch 52, CIFAR-10 Batch 21:  Loss:     0.1680 Validation Accuracy: 0.879400
Epoch 52, CIFAR-10 Batch 22:  Loss:     0.1818 Validation Accuracy: 0.849800
Epoch 52, CIFAR-10 Batch 23:  Loss:     0.1629 Validation Accuracy: 0.881000
Epoch 52, CIFAR-10 Batch 24:  Loss:     0.2252 Validation Accuracy: 0.880400
Epoch 52, CIFAR-10 Batch 25:  Loss:     0.1695 Validation Accuracy: 0.865200
Epoch 52, CIFAR-10 Batch 26:  Loss:     0.1842 Validation Accuracy: 0.877000
Epoch 52, CIFAR-10 Batch 27:  Loss:     0.1415 Validation Accuracy: 0.878800
Epoch 52, CIFAR-10 Batch 28:  Loss:     0.3175 Validation Accuracy: 0.870000
Epoch 52, CIFAR-10 Batch 29:  Loss:     0.1446 Validation Accuracy: 0.877800
Epoch 52, CIFAR-10 Batch 30:  Loss:     0.1454 Validation Accuracy: 0.876600
Epoch 52, CIFAR-10 Batch 31:  Loss:     0.1648 Validation Accuracy: 0.880000
Epoch 52, CIFAR-10 Batch 32:  Loss:     0.1396 Validation Accuracy: 0.871000
Epoch 52, CIFAR-10 Batch 33:  Loss:     0.2649 Validation Accuracy: 0.865800
Epoch 52, CIFAR-10 Batch 34:  Loss:     0.3741 Validation Accuracy: 0.867200
Epoch 52, CIFAR-10 Batch 35:  Loss:     0.2204 Validation Accuracy: 0.875200
Epoch 52, CIFAR-10 Batch 36:  Loss:     0.2768 Validation Accuracy: 0.863800
Epoch 52, CIFAR-10 Batch 37:  Loss:     0.1938 Validation Accuracy: 0.855600
Epoch 52, CIFAR-10 Batch 38:  Loss:     0.1315 Validation Accuracy: 0.870400
Epoch 52, CIFAR-10 Batch 39:  Loss:     0.1494 Validation Accuracy: 0.879200
Epoch 52, CIFAR-10 Batch 40:  Loss:     0.2002 Validation Accuracy: 0.874800
Epoch 52, CIFAR-10 Batch 41:  Loss:     0.1869 Validation Accuracy: 0.872600
Epoch 52, CIFAR-10 Batch 42:  Loss:     0.2211 Validation Accuracy: 0.888800
Epoch 52, CIFAR-10 Batch 43:  Loss:     0.2178 Validation Accuracy: 0.881000
Epoch 52, CIFAR-10 Batch 44:  Loss:     0.1716 Validation Accuracy: 0.874400
Epoch 52, CIFAR-10 Batch 45:  Loss:     0.1577 Validation Accuracy: 0.873200
Epoch 52, CIFAR-10 Batch 46:  Loss:     0.1790 Validation Accuracy: 0.846600
Epoch 52, CIFAR-10 Batch 47:  Loss:     0.1832 Validation Accuracy: 0.882000
Epoch 52, CIFAR-10 Batch 48:  Loss:     0.1693 Validation Accuracy: 0.875400
Epoch 52, CIFAR-10 Batch 49:  Loss:     0.2368 Validation Accuracy: 0.887000
Epoch 52, CIFAR-10 Batch 50:  Loss:     0.2086 Validation Accuracy: 0.877800
Epoch 53, CIFAR-10 Batch 1:  Loss:     0.1797 Validation Accuracy: 0.868000
Epoch 53, CIFAR-10 Batch 2:  Loss:     0.2015 Validation Accuracy: 0.882200
Epoch 53, CIFAR-10 Batch 3:  Loss:     0.1344 Validation Accuracy: 0.883600
Epoch 53, CIFAR-10 Batch 4:  Loss:     0.1520 Validation Accuracy: 0.867600
Epoch 53, CIFAR-10 Batch 5:  Loss:     0.1591 Validation Accuracy: 0.878800
Epoch 53, CIFAR-10 Batch 6:  Loss:     0.2558 Validation Accuracy: 0.883800
Epoch 53, CIFAR-10 Batch 7:  Loss:     0.1448 Validation Accuracy: 0.874400
Epoch 53, CIFAR-10 Batch 8:  Loss:     0.2175 Validation Accuracy: 0.871600
Epoch 53, CIFAR-10 Batch 9:  Loss:     0.2012 Validation Accuracy: 0.869600
Epoch 53, CIFAR-10 Batch 10:  Loss:     0.1331 Validation Accuracy: 0.875600
Epoch 53, CIFAR-10 Batch 11:  Loss:     0.1768 Validation Accuracy: 0.883600
Epoch 53, CIFAR-10 Batch 12:  Loss:     0.1646 Validation Accuracy: 0.874000
Epoch 53, CIFAR-10 Batch 13:  Loss:     0.2118 Validation Accuracy: 0.863600
Epoch 53, CIFAR-10 Batch 14:  Loss:     0.1631 Validation Accuracy: 0.876000
Epoch 53, CIFAR-10 Batch 15:  Loss:     0.1631 Validation Accuracy: 0.881800
Epoch 53, CIFAR-10 Batch 16:  Loss:     0.1696 Validation Accuracy: 0.881800
Epoch 53, CIFAR-10 Batch 17:  Loss:     0.2164 Validation Accuracy: 0.875600
Epoch 53, CIFAR-10 Batch 18:  Loss:     0.1632 Validation Accuracy: 0.870000
Epoch 53, CIFAR-10 Batch 19:  Loss:     0.1804 Validation Accuracy: 0.885600
Epoch 53, CIFAR-10 Batch 20:  Loss:     0.2213 Validation Accuracy: 0.866200
Epoch 53, CIFAR-10 Batch 21:  Loss:     0.1734 Validation Accuracy: 0.884000
Epoch 53, CIFAR-10 Batch 22:  Loss:     0.1671 Validation Accuracy: 0.883800
Epoch 53, CIFAR-10 Batch 23:  Loss:     0.1647 Validation Accuracy: 0.873400
Epoch 53, CIFAR-10 Batch 24:  Loss:     0.1949 Validation Accuracy: 0.887800
Epoch 53, CIFAR-10 Batch 25:  Loss:     0.1833 Validation Accuracy: 0.867800
Epoch 53, CIFAR-10 Batch 26:  Loss:     0.2311 Validation Accuracy: 0.873800
Epoch 53, CIFAR-10 Batch 27:  Loss:     0.1390 Validation Accuracy: 0.874800
Epoch 53, CIFAR-10 Batch 28:  Loss:     0.2600 Validation Accuracy: 0.880000
Epoch 53, CIFAR-10 Batch 29:  Loss:     0.1500 Validation Accuracy: 0.873600
Epoch 53, CIFAR-10 Batch 30:  Loss:     0.1329 Validation Accuracy: 0.878800
Epoch 53, CIFAR-10 Batch 31:  Loss:     0.1613 Validation Accuracy: 0.864600
Epoch 53, CIFAR-10 Batch 32:  Loss:     0.1719 Validation Accuracy: 0.880800
Epoch 53, CIFAR-10 Batch 33:  Loss:     0.1979 Validation Accuracy: 0.878800
Epoch 53, CIFAR-10 Batch 34:  Loss:     0.3178 Validation Accuracy: 0.885600
Epoch 53, CIFAR-10 Batch 35:  Loss:     0.2547 Validation Accuracy: 0.870600
Epoch 53, CIFAR-10 Batch 36:  Loss:     0.2577 Validation Accuracy: 0.874400
Epoch 53, CIFAR-10 Batch 37:  Loss:     0.1575 Validation Accuracy: 0.863600
Epoch 53, CIFAR-10 Batch 38:  Loss:     0.1308 Validation Accuracy: 0.876200
Epoch 53, CIFAR-10 Batch 39:  Loss:     0.1354 Validation Accuracy: 0.881000
Epoch 53, CIFAR-10 Batch 40:  Loss:     0.1839 Validation Accuracy: 0.877600
Epoch 53, CIFAR-10 Batch 41:  Loss:     0.1642 Validation Accuracy: 0.882600
Epoch 53, CIFAR-10 Batch 42:  Loss:     0.2054 Validation Accuracy: 0.863400
Epoch 53, CIFAR-10 Batch 43:  Loss:     0.2755 Validation Accuracy: 0.863600
Epoch 53, CIFAR-10 Batch 44:  Loss:     0.1550 Validation Accuracy: 0.864200
Epoch 53, CIFAR-10 Batch 45:  Loss:     0.2039 Validation Accuracy: 0.884600
Epoch 53, CIFAR-10 Batch 46:  Loss:     0.1956 Validation Accuracy: 0.873800
Epoch 53, CIFAR-10 Batch 47:  Loss:     0.1627 Validation Accuracy: 0.877000
Epoch 53, CIFAR-10 Batch 48:  Loss:     0.1768 Validation Accuracy: 0.883400
Epoch 53, CIFAR-10 Batch 49:  Loss:     0.1929 Validation Accuracy: 0.879000
Epoch 53, CIFAR-10 Batch 50:  Loss:     0.1666 Validation Accuracy: 0.883600
Epoch 54, CIFAR-10 Batch 1:  Loss:     0.1642 Validation Accuracy: 0.859200
Epoch 54, CIFAR-10 Batch 2:  Loss:     0.1574 Validation Accuracy: 0.884200
Epoch 54, CIFAR-10 Batch 3:  Loss:     0.1323 Validation Accuracy: 0.884400
Epoch 54, CIFAR-10 Batch 4:  Loss:     0.1573 Validation Accuracy: 0.878800
Epoch 54, CIFAR-10 Batch 5:  Loss:     0.1825 Validation Accuracy: 0.881000
Epoch 54, CIFAR-10 Batch 6:  Loss:     0.2870 Validation Accuracy: 0.863400
Epoch 54, CIFAR-10 Batch 7:  Loss:     0.1702 Validation Accuracy: 0.869000
Epoch 54, CIFAR-10 Batch 8:  Loss:     0.2320 Validation Accuracy: 0.876200
Epoch 54, CIFAR-10 Batch 9:  Loss:     0.1517 Validation Accuracy: 0.877200
Epoch 54, CIFAR-10 Batch 10:  Loss:     0.1285 Validation Accuracy: 0.872400
Epoch 54, CIFAR-10 Batch 11:  Loss:     0.1393 Validation Accuracy: 0.841800
Epoch 54, CIFAR-10 Batch 12:  Loss:     0.1656 Validation Accuracy: 0.859000
Epoch 54, CIFAR-10 Batch 13:  Loss:     0.1634 Validation Accuracy: 0.880800
Epoch 54, CIFAR-10 Batch 14:  Loss:     0.1712 Validation Accuracy: 0.875600
Epoch 54, CIFAR-10 Batch 15:  Loss:     0.1506 Validation Accuracy: 0.879000
Epoch 54, CIFAR-10 Batch 16:  Loss:     0.1705 Validation Accuracy: 0.866200
Epoch 54, CIFAR-10 Batch 17:  Loss:     0.2011 Validation Accuracy: 0.865400
Epoch 54, CIFAR-10 Batch 18:  Loss:     0.1887 Validation Accuracy: 0.854400
Epoch 54, CIFAR-10 Batch 19:  Loss:     0.1405 Validation Accuracy: 0.870200
Epoch 54, CIFAR-10 Batch 20:  Loss:     0.2730 Validation Accuracy: 0.879800
Epoch 54, CIFAR-10 Batch 21:  Loss:     0.1649 Validation Accuracy: 0.882400
Epoch 54, CIFAR-10 Batch 22:  Loss:     0.2211 Validation Accuracy: 0.880800
Epoch 54, CIFAR-10 Batch 23:  Loss:     0.1812 Validation Accuracy: 0.871800
Epoch 54, CIFAR-10 Batch 24:  Loss:     0.1666 Validation Accuracy: 0.884800
Epoch 54, CIFAR-10 Batch 25:  Loss:     0.2147 Validation Accuracy: 0.866400
Epoch 54, CIFAR-10 Batch 26:  Loss:     0.1733 Validation Accuracy: 0.888000
Epoch 54, CIFAR-10 Batch 27:  Loss:     0.1365 Validation Accuracy: 0.885000
Epoch 54, CIFAR-10 Batch 28:  Loss:     0.2813 Validation Accuracy: 0.877200
Epoch 54, CIFAR-10 Batch 29:  Loss:     0.1756 Validation Accuracy: 0.878000
Epoch 54, CIFAR-10 Batch 30:  Loss:     0.1329 Validation Accuracy: 0.878200
Epoch 54, CIFAR-10 Batch 31:  Loss:     0.1686 Validation Accuracy: 0.882600
Epoch 54, CIFAR-10 Batch 32:  Loss:     0.1522 Validation Accuracy: 0.869400
Epoch 54, CIFAR-10 Batch 33:  Loss:     0.2398 Validation Accuracy: 0.868600
Epoch 54, CIFAR-10 Batch 34:  Loss:     0.2287 Validation Accuracy: 0.875000
Epoch 54, CIFAR-10 Batch 35:  Loss:     0.2282 Validation Accuracy: 0.874200
Epoch 54, CIFAR-10 Batch 36:  Loss:     0.2711 Validation Accuracy: 0.872600
Epoch 54, CIFAR-10 Batch 37:  Loss:     0.1704 Validation Accuracy: 0.861800
Epoch 54, CIFAR-10 Batch 38:  Loss:     0.1367 Validation Accuracy: 0.882000
Epoch 54, CIFAR-10 Batch 39:  Loss:     0.1336 Validation Accuracy: 0.878400
Epoch 54, CIFAR-10 Batch 40:  Loss:     0.1873 Validation Accuracy: 0.874000
Epoch 54, CIFAR-10 Batch 41:  Loss:     0.1670 Validation Accuracy: 0.877000
Epoch 54, CIFAR-10 Batch 42:  Loss:     0.1866 Validation Accuracy: 0.889600
Epoch 54, CIFAR-10 Batch 43:  Loss:     0.2432 Validation Accuracy: 0.881800
Epoch 54, CIFAR-10 Batch 44:  Loss:     0.1950 Validation Accuracy: 0.880000
Epoch 54, CIFAR-10 Batch 45:  Loss:     0.1759 Validation Accuracy: 0.876000
Epoch 54, CIFAR-10 Batch 46:  Loss:     0.1774 Validation Accuracy: 0.886400
Epoch 54, CIFAR-10 Batch 47:  Loss:     0.1647 Validation Accuracy: 0.880200
Epoch 54, CIFAR-10 Batch 48:  Loss:     0.1552 Validation Accuracy: 0.882000
Epoch 54, CIFAR-10 Batch 49:  Loss:     0.2405 Validation Accuracy: 0.878600
Epoch 54, CIFAR-10 Batch 50:  Loss:     0.1890 Validation Accuracy: 0.872400
Epoch 55, CIFAR-10 Batch 1:  Loss:     0.1460 Validation Accuracy: 0.871600
Epoch 55, CIFAR-10 Batch 2:  Loss:     0.1460 Validation Accuracy: 0.880800
Epoch 55, CIFAR-10 Batch 3:  Loss:     0.1371 Validation Accuracy: 0.873400
Epoch 55, CIFAR-10 Batch 4:  Loss:     0.1448 Validation Accuracy: 0.875000
Epoch 55, CIFAR-10 Batch 5:  Loss:     0.1605 Validation Accuracy: 0.880200
Epoch 55, CIFAR-10 Batch 6:  Loss:     0.2429 Validation Accuracy: 0.875600
Epoch 55, CIFAR-10 Batch 7:  Loss:     0.1398 Validation Accuracy: 0.885200
Epoch 55, CIFAR-10 Batch 8:  Loss:     0.2766 Validation Accuracy: 0.881000
Epoch 55, CIFAR-10 Batch 9:  Loss:     0.1620 Validation Accuracy: 0.874000
Epoch 55, CIFAR-10 Batch 10:  Loss:     0.1406 Validation Accuracy: 0.883000
Epoch 55, CIFAR-10 Batch 11:  Loss:     0.1614 Validation Accuracy: 0.880800
Epoch 55, CIFAR-10 Batch 12:  Loss:     0.1704 Validation Accuracy: 0.878800
Epoch 55, CIFAR-10 Batch 13:  Loss:     0.2114 Validation Accuracy: 0.880200
Epoch 55, CIFAR-10 Batch 14:  Loss:     0.1858 Validation Accuracy: 0.878400
Epoch 55, CIFAR-10 Batch 15:  Loss:     0.1760 Validation Accuracy: 0.888000
Epoch 55, CIFAR-10 Batch 16:  Loss:     0.1484 Validation Accuracy: 0.877600
Epoch 55, CIFAR-10 Batch 17:  Loss:     0.2252 Validation Accuracy: 0.868000
Epoch 55, CIFAR-10 Batch 18:  Loss:     0.1548 Validation Accuracy: 0.861600
Epoch 55, CIFAR-10 Batch 19:  Loss:     0.1820 Validation Accuracy: 0.880600
Epoch 55, CIFAR-10 Batch 20:  Loss:     0.2484 Validation Accuracy: 0.869200
Epoch 55, CIFAR-10 Batch 21:  Loss:     0.1484 Validation Accuracy: 0.886400
Epoch 55, CIFAR-10 Batch 22:  Loss:     0.1683 Validation Accuracy: 0.883000
Epoch 55, CIFAR-10 Batch 23:  Loss:     0.1984 Validation Accuracy: 0.873600
Epoch 55, CIFAR-10 Batch 24:  Loss:     0.1707 Validation Accuracy: 0.880400
Epoch 55, CIFAR-10 Batch 25:  Loss:     0.2612 Validation Accuracy: 0.855400
Epoch 55, CIFAR-10 Batch 26:  Loss:     0.2058 Validation Accuracy: 0.885600
Epoch 55, CIFAR-10 Batch 27:  Loss:     0.1441 Validation Accuracy: 0.873200
Epoch 55, CIFAR-10 Batch 28:  Loss:     0.2259 Validation Accuracy: 0.872600
Epoch 55, CIFAR-10 Batch 29:  Loss:     0.1782 Validation Accuracy: 0.876000
Epoch 55, CIFAR-10 Batch 30:  Loss:     0.1649 Validation Accuracy: 0.883200
Epoch 55, CIFAR-10 Batch 31:  Loss:     0.1985 Validation Accuracy: 0.874400
Epoch 55, CIFAR-10 Batch 32:  Loss:     0.1360 Validation Accuracy: 0.870800
Epoch 55, CIFAR-10 Batch 33:  Loss:     0.2175 Validation Accuracy: 0.870800
Epoch 55, CIFAR-10 Batch 34:  Loss:     0.2829 Validation Accuracy: 0.845600
Epoch 55, CIFAR-10 Batch 35:  Loss:     0.2028 Validation Accuracy: 0.884200
Epoch 55, CIFAR-10 Batch 36:  Loss:     0.2220 Validation Accuracy: 0.863200
Epoch 55, CIFAR-10 Batch 37:  Loss:     0.1486 Validation Accuracy: 0.867200
Epoch 55, CIFAR-10 Batch 38:  Loss:     0.1445 Validation Accuracy: 0.872000
Epoch 55, CIFAR-10 Batch 39:  Loss:     0.1517 Validation Accuracy: 0.872600
Epoch 55, CIFAR-10 Batch 40:  Loss:     0.1755 Validation Accuracy: 0.866800
Epoch 55, CIFAR-10 Batch 41:  Loss:     0.1713 Validation Accuracy: 0.877000
Epoch 55, CIFAR-10 Batch 42:  Loss:     0.1738 Validation Accuracy: 0.872000
Epoch 55, CIFAR-10 Batch 43:  Loss:     0.2738 Validation Accuracy: 0.887000
Epoch 55, CIFAR-10 Batch 44:  Loss:     0.1752 Validation Accuracy: 0.875400
Epoch 55, CIFAR-10 Batch 45:  Loss:     0.1561 Validation Accuracy: 0.888400
Epoch 55, CIFAR-10 Batch 46:  Loss:     0.1756 Validation Accuracy: 0.862600
Epoch 55, CIFAR-10 Batch 47:  Loss:     0.1612 Validation Accuracy: 0.881000
Epoch 55, CIFAR-10 Batch 48:  Loss:     0.1550 Validation Accuracy: 0.872600
Epoch 55, CIFAR-10 Batch 49:  Loss:     0.2193 Validation Accuracy: 0.877000
Epoch 55, CIFAR-10 Batch 50:  Loss:     0.1623 Validation Accuracy: 0.871400
Epoch 56, CIFAR-10 Batch 1:  Loss:     0.1409 Validation Accuracy: 0.878600
Epoch 56, CIFAR-10 Batch 2:  Loss:     0.1888 Validation Accuracy: 0.873800
Epoch 56, CIFAR-10 Batch 3:  Loss:     0.1364 Validation Accuracy: 0.882200
Epoch 56, CIFAR-10 Batch 4:  Loss:     0.1469 Validation Accuracy: 0.885400
Epoch 56, CIFAR-10 Batch 5:  Loss:     0.1620 Validation Accuracy: 0.884400
Epoch 56, CIFAR-10 Batch 6:  Loss:     0.3087 Validation Accuracy: 0.871400
Epoch 56, CIFAR-10 Batch 7:  Loss:     0.1912 Validation Accuracy: 0.879400
Epoch 56, CIFAR-10 Batch 8:  Loss:     0.2258 Validation Accuracy: 0.880800
Epoch 56, CIFAR-10 Batch 9:  Loss:     0.1441 Validation Accuracy: 0.887800
Epoch 56, CIFAR-10 Batch 10:  Loss:     0.1326 Validation Accuracy: 0.878400
Epoch 56, CIFAR-10 Batch 11:  Loss:     0.1675 Validation Accuracy: 0.869600
Epoch 56, CIFAR-10 Batch 12:  Loss:     0.1523 Validation Accuracy: 0.880400
Epoch 56, CIFAR-10 Batch 13:  Loss:     0.1668 Validation Accuracy: 0.875000
Epoch 56, CIFAR-10 Batch 14:  Loss:     0.1544 Validation Accuracy: 0.872800
Epoch 56, CIFAR-10 Batch 15:  Loss:     0.1553 Validation Accuracy: 0.866400
Epoch 56, CIFAR-10 Batch 16:  Loss:     0.1526 Validation Accuracy: 0.872400
Epoch 56, CIFAR-10 Batch 17:  Loss:     0.2086 Validation Accuracy: 0.879800
Epoch 56, CIFAR-10 Batch 18:  Loss:     0.1449 Validation Accuracy: 0.871400
Epoch 56, CIFAR-10 Batch 19:  Loss:     0.1374 Validation Accuracy: 0.877800
Epoch 56, CIFAR-10 Batch 20:  Loss:     0.2662 Validation Accuracy: 0.885200
Epoch 56, CIFAR-10 Batch 21:  Loss:     0.1737 Validation Accuracy: 0.877800
Epoch 56, CIFAR-10 Batch 22:  Loss:     0.1694 Validation Accuracy: 0.880400
Epoch 56, CIFAR-10 Batch 23:  Loss:     0.1826 Validation Accuracy: 0.875000
Epoch 56, CIFAR-10 Batch 24:  Loss:     0.2136 Validation Accuracy: 0.879000
Epoch 56, CIFAR-10 Batch 25:  Loss:     0.1872 Validation Accuracy: 0.870000
Epoch 56, CIFAR-10 Batch 26:  Loss:     0.1798 Validation Accuracy: 0.876800
Epoch 56, CIFAR-10 Batch 27:  Loss:     0.1427 Validation Accuracy: 0.868000
Epoch 56, CIFAR-10 Batch 28:  Loss:     0.2244 Validation Accuracy: 0.881200
Epoch 56, CIFAR-10 Batch 29:  Loss:     0.1512 Validation Accuracy: 0.874800
Epoch 56, CIFAR-10 Batch 30:  Loss:     0.1373 Validation Accuracy: 0.874800
Epoch 56, CIFAR-10 Batch 31:  Loss:     0.1651 Validation Accuracy: 0.879800
Epoch 56, CIFAR-10 Batch 32:  Loss:     0.1509 Validation Accuracy: 0.873600
Epoch 56, CIFAR-10 Batch 33:  Loss:     0.2205 Validation Accuracy: 0.858800
Epoch 56, CIFAR-10 Batch 34:  Loss:     0.2955 Validation Accuracy: 0.855000
Epoch 56, CIFAR-10 Batch 35:  Loss:     0.2586 Validation Accuracy: 0.882000
Epoch 56, CIFAR-10 Batch 36:  Loss:     0.2572 Validation Accuracy: 0.879200
Epoch 56, CIFAR-10 Batch 37:  Loss:     0.1796 Validation Accuracy: 0.885000
Epoch 56, CIFAR-10 Batch 38:  Loss:     0.1422 Validation Accuracy: 0.876000
Epoch 56, CIFAR-10 Batch 39:  Loss:     0.1331 Validation Accuracy: 0.875000
Epoch 56, CIFAR-10 Batch 40:  Loss:     0.1902 Validation Accuracy: 0.879400
Epoch 56, CIFAR-10 Batch 41:  Loss:     0.1891 Validation Accuracy: 0.880200
Epoch 56, CIFAR-10 Batch 42:  Loss:     0.1894 Validation Accuracy: 0.867000
Epoch 56, CIFAR-10 Batch 43:  Loss:     0.2344 Validation Accuracy: 0.875000
Epoch 56, CIFAR-10 Batch 44:  Loss:     0.1807 Validation Accuracy: 0.876800
Epoch 56, CIFAR-10 Batch 45:  Loss:     0.1661 Validation Accuracy: 0.879200
Epoch 56, CIFAR-10 Batch 46:  Loss:     0.1920 Validation Accuracy: 0.867400
Epoch 56, CIFAR-10 Batch 47:  Loss:     0.1665 Validation Accuracy: 0.874000
Epoch 56, CIFAR-10 Batch 48:  Loss:     0.1726 Validation Accuracy: 0.883800
Epoch 56, CIFAR-10 Batch 49:  Loss:     0.2154 Validation Accuracy: 0.870800
Epoch 56, CIFAR-10 Batch 50:  Loss:     0.1799 Validation Accuracy: 0.890800
Epoch 57, CIFAR-10 Batch 1:  Loss:     0.2063 Validation Accuracy: 0.881000
Epoch 57, CIFAR-10 Batch 2:  Loss:     0.1686 Validation Accuracy: 0.869200
Epoch 57, CIFAR-10 Batch 3:  Loss:     0.1407 Validation Accuracy: 0.871800
Epoch 57, CIFAR-10 Batch 4:  Loss:     0.1984 Validation Accuracy: 0.884000
Epoch 57, CIFAR-10 Batch 5:  Loss:     0.1823 Validation Accuracy: 0.874600
Epoch 57, CIFAR-10 Batch 6:  Loss:     0.2652 Validation Accuracy: 0.882200
Epoch 57, CIFAR-10 Batch 7:  Loss:     0.1844 Validation Accuracy: 0.865000
Epoch 57, CIFAR-10 Batch 8:  Loss:     0.2091 Validation Accuracy: 0.885400
Epoch 57, CIFAR-10 Batch 9:  Loss:     0.1843 Validation Accuracy: 0.861800
Epoch 57, CIFAR-10 Batch 10:  Loss:     0.1353 Validation Accuracy: 0.873800
Epoch 57, CIFAR-10 Batch 11:  Loss:     0.1954 Validation Accuracy: 0.871600
Epoch 57, CIFAR-10 Batch 12:  Loss:     0.1598 Validation Accuracy: 0.863800
Epoch 57, CIFAR-10 Batch 13:  Loss:     0.1706 Validation Accuracy: 0.873400
Epoch 57, CIFAR-10 Batch 14:  Loss:     0.1696 Validation Accuracy: 0.875600
Epoch 57, CIFAR-10 Batch 15:  Loss:     0.1582 Validation Accuracy: 0.882000
Epoch 57, CIFAR-10 Batch 16:  Loss:     0.1796 Validation Accuracy: 0.877600
Epoch 57, CIFAR-10 Batch 17:  Loss:     0.2256 Validation Accuracy: 0.864800
Epoch 57, CIFAR-10 Batch 18:  Loss:     0.1541 Validation Accuracy: 0.864400
Epoch 57, CIFAR-10 Batch 19:  Loss:     0.1561 Validation Accuracy: 0.873000
Epoch 57, CIFAR-10 Batch 20:  Loss:     0.2213 Validation Accuracy: 0.875800
Epoch 57, CIFAR-10 Batch 21:  Loss:     0.1444 Validation Accuracy: 0.871800
Epoch 57, CIFAR-10 Batch 22:  Loss:     0.1782 Validation Accuracy: 0.885800
Epoch 57, CIFAR-10 Batch 23:  Loss:     0.1660 Validation Accuracy: 0.890200
Epoch 57, CIFAR-10 Batch 24:  Loss:     0.1752 Validation Accuracy: 0.881000
Epoch 57, CIFAR-10 Batch 25:  Loss:     0.2166 Validation Accuracy: 0.865000
Epoch 57, CIFAR-10 Batch 26:  Loss:     0.1849 Validation Accuracy: 0.880400
Epoch 57, CIFAR-10 Batch 27:  Loss:     0.1460 Validation Accuracy: 0.877400
Epoch 57, CIFAR-10 Batch 28:  Loss:     0.2796 Validation Accuracy: 0.867200
Epoch 57, CIFAR-10 Batch 29:  Loss:     0.1546 Validation Accuracy: 0.877800
Epoch 57, CIFAR-10 Batch 30:  Loss:     0.1503 Validation Accuracy: 0.882000
Epoch 57, CIFAR-10 Batch 31:  Loss:     0.1564 Validation Accuracy: 0.878000
Epoch 57, CIFAR-10 Batch 32:  Loss:     0.1437 Validation Accuracy: 0.874800
Epoch 57, CIFAR-10 Batch 33:  Loss:     0.2279 Validation Accuracy: 0.882000
Epoch 57, CIFAR-10 Batch 34:  Loss:     0.2848 Validation Accuracy: 0.875000
Epoch 57, CIFAR-10 Batch 35:  Loss:     0.2473 Validation Accuracy: 0.867600
Epoch 57, CIFAR-10 Batch 36:  Loss:     0.2755 Validation Accuracy: 0.870600
Epoch 57, CIFAR-10 Batch 37:  Loss:     0.1457 Validation Accuracy: 0.874600
Epoch 57, CIFAR-10 Batch 38:  Loss:     0.1313 Validation Accuracy: 0.877400
Epoch 57, CIFAR-10 Batch 39:  Loss:     0.1318 Validation Accuracy: 0.885400
Epoch 57, CIFAR-10 Batch 40:  Loss:     0.1596 Validation Accuracy: 0.876800
Epoch 57, CIFAR-10 Batch 41:  Loss:     0.1642 Validation Accuracy: 0.866000
Epoch 57, CIFAR-10 Batch 42:  Loss:     0.1659 Validation Accuracy: 0.877200
Epoch 57, CIFAR-10 Batch 43:  Loss:     0.2733 Validation Accuracy: 0.883200
Epoch 57, CIFAR-10 Batch 44:  Loss:     0.1744 Validation Accuracy: 0.866400
Epoch 57, CIFAR-10 Batch 45:  Loss:     0.1472 Validation Accuracy: 0.886000
Epoch 57, CIFAR-10 Batch 46:  Loss:     0.2041 Validation Accuracy: 0.878200
Epoch 57, CIFAR-10 Batch 47:  Loss:     0.1569 Validation Accuracy: 0.881800
Epoch 57, CIFAR-10 Batch 48:  Loss:     0.2044 Validation Accuracy: 0.886000
Epoch 57, CIFAR-10 Batch 49:  Loss:     0.2231 Validation Accuracy: 0.872600
Epoch 57, CIFAR-10 Batch 50:  Loss:     0.1617 Validation Accuracy: 0.885200
Epoch 58, CIFAR-10 Batch 1:  Loss:     0.1588 Validation Accuracy: 0.889800
Epoch 58, CIFAR-10 Batch 2:  Loss:     0.1833 Validation Accuracy: 0.887200
Epoch 58, CIFAR-10 Batch 3:  Loss:     0.1811 Validation Accuracy: 0.875000
Epoch 58, CIFAR-10 Batch 4:  Loss:     0.2274 Validation Accuracy: 0.887600
Epoch 58, CIFAR-10 Batch 5:  Loss:     0.1660 Validation Accuracy: 0.889800
Epoch 58, CIFAR-10 Batch 6:  Loss:     0.3195 Validation Accuracy: 0.874000
Epoch 58, CIFAR-10 Batch 7:  Loss:     0.1507 Validation Accuracy: 0.878400
Epoch 58, CIFAR-10 Batch 8:  Loss:     0.1985 Validation Accuracy: 0.889600
Epoch 58, CIFAR-10 Batch 9:  Loss:     0.1826 Validation Accuracy: 0.875400
Epoch 58, CIFAR-10 Batch 10:  Loss:     0.1311 Validation Accuracy: 0.883000
Epoch 58, CIFAR-10 Batch 11:  Loss:     0.2147 Validation Accuracy: 0.887600
Epoch 58, CIFAR-10 Batch 12:  Loss:     0.1765 Validation Accuracy: 0.872400
Epoch 58, CIFAR-10 Batch 13:  Loss:     0.2065 Validation Accuracy: 0.858800
Epoch 58, CIFAR-10 Batch 14:  Loss:     0.2427 Validation Accuracy: 0.872600
Epoch 58, CIFAR-10 Batch 15:  Loss:     0.1603 Validation Accuracy: 0.880000
Epoch 58, CIFAR-10 Batch 16:  Loss:     0.1592 Validation Accuracy: 0.884600
Epoch 58, CIFAR-10 Batch 17:  Loss:     0.1955 Validation Accuracy: 0.871600
Epoch 58, CIFAR-10 Batch 18:  Loss:     0.1530 Validation Accuracy: 0.864200
Epoch 58, CIFAR-10 Batch 19:  Loss:     0.1592 Validation Accuracy: 0.869600
Epoch 58, CIFAR-10 Batch 20:  Loss:     0.2351 Validation Accuracy: 0.882400
Epoch 58, CIFAR-10 Batch 21:  Loss:     0.1601 Validation Accuracy: 0.874000
Epoch 58, CIFAR-10 Batch 22:  Loss:     0.1813 Validation Accuracy: 0.870200
Epoch 58, CIFAR-10 Batch 23:  Loss:     0.1647 Validation Accuracy: 0.885400
Epoch 58, CIFAR-10 Batch 24:  Loss:     0.1786 Validation Accuracy: 0.880400
Epoch 58, CIFAR-10 Batch 25:  Loss:     0.1680 Validation Accuracy: 0.871000
Epoch 58, CIFAR-10 Batch 26:  Loss:     0.1755 Validation Accuracy: 0.887000
Epoch 58, CIFAR-10 Batch 27:  Loss:     0.1687 Validation Accuracy: 0.870400
Epoch 58, CIFAR-10 Batch 28:  Loss:     0.2120 Validation Accuracy: 0.866800
Epoch 58, CIFAR-10 Batch 29:  Loss:     0.1435 Validation Accuracy: 0.877200
Epoch 58, CIFAR-10 Batch 30:  Loss:     0.1322 Validation Accuracy: 0.864600
Epoch 58, CIFAR-10 Batch 31:  Loss:     0.1420 Validation Accuracy: 0.884000
Epoch 58, CIFAR-10 Batch 32:  Loss:     0.1599 Validation Accuracy: 0.881200
Epoch 58, CIFAR-10 Batch 33:  Loss:     0.2136 Validation Accuracy: 0.869400
Epoch 58, CIFAR-10 Batch 34:  Loss:     0.2683 Validation Accuracy: 0.876800
Epoch 58, CIFAR-10 Batch 35:  Loss:     0.2515 Validation Accuracy: 0.878800
Epoch 58, CIFAR-10 Batch 36:  Loss:     0.2490 Validation Accuracy: 0.869000
Epoch 58, CIFAR-10 Batch 37:  Loss:     0.1648 Validation Accuracy: 0.875800
Epoch 58, CIFAR-10 Batch 38:  Loss:     0.1401 Validation Accuracy: 0.876400
Epoch 58, CIFAR-10 Batch 39:  Loss:     0.1332 Validation Accuracy: 0.882000
Epoch 58, CIFAR-10 Batch 40:  Loss:     0.1554 Validation Accuracy: 0.860600
Epoch 58, CIFAR-10 Batch 41:  Loss:     0.1743 Validation Accuracy: 0.882200
Epoch 58, CIFAR-10 Batch 42:  Loss:     0.1791 Validation Accuracy: 0.859000
Epoch 58, CIFAR-10 Batch 43:  Loss:     0.2543 Validation Accuracy: 0.880800
Epoch 58, CIFAR-10 Batch 44:  Loss:     0.1891 Validation Accuracy: 0.861800
Epoch 58, CIFAR-10 Batch 45:  Loss:     0.1474 Validation Accuracy: 0.882400
Epoch 58, CIFAR-10 Batch 46:  Loss:     0.1711 Validation Accuracy: 0.874600
Epoch 58, CIFAR-10 Batch 47:  Loss:     0.1555 Validation Accuracy: 0.883600
Epoch 58, CIFAR-10 Batch 48:  Loss:     0.1977 Validation Accuracy: 0.871000
Epoch 58, CIFAR-10 Batch 49:  Loss:     0.2040 Validation Accuracy: 0.884800
Epoch 58, CIFAR-10 Batch 50:  Loss:     0.1856 Validation Accuracy: 0.882600
Epoch 59, CIFAR-10 Batch 1:  Loss:     0.1503 Validation Accuracy: 0.884200
Epoch 59, CIFAR-10 Batch 2:  Loss:     0.1525 Validation Accuracy: 0.882400
Epoch 59, CIFAR-10 Batch 3:  Loss:     0.1545 Validation Accuracy: 0.882600
Epoch 59, CIFAR-10 Batch 4:  Loss:     0.1676 Validation Accuracy: 0.871000
Epoch 59, CIFAR-10 Batch 5:  Loss:     0.2004 Validation Accuracy: 0.886600
Epoch 59, CIFAR-10 Batch 6:  Loss:     0.2685 Validation Accuracy: 0.879800
Epoch 59, CIFAR-10 Batch 7:  Loss:     0.1493 Validation Accuracy: 0.870800
Epoch 59, CIFAR-10 Batch 8:  Loss:     0.2077 Validation Accuracy: 0.877800
Epoch 59, CIFAR-10 Batch 9:  Loss:     0.1720 Validation Accuracy: 0.872800
Epoch 59, CIFAR-10 Batch 10:  Loss:     0.1332 Validation Accuracy: 0.881200
Epoch 59, CIFAR-10 Batch 11:  Loss:     0.1451 Validation Accuracy: 0.880200
Epoch 59, CIFAR-10 Batch 12:  Loss:     0.1763 Validation Accuracy: 0.877800
Epoch 59, CIFAR-10 Batch 13:  Loss:     0.1920 Validation Accuracy: 0.868400
Epoch 59, CIFAR-10 Batch 14:  Loss:     0.1669 Validation Accuracy: 0.868000
Epoch 59, CIFAR-10 Batch 15:  Loss:     0.1750 Validation Accuracy: 0.882200
Epoch 59, CIFAR-10 Batch 16:  Loss:     0.1619 Validation Accuracy: 0.863000
Epoch 59, CIFAR-10 Batch 17:  Loss:     0.2492 Validation Accuracy: 0.868800
Epoch 59, CIFAR-10 Batch 18:  Loss:     0.1867 Validation Accuracy: 0.855000
Epoch 59, CIFAR-10 Batch 19:  Loss:     0.1452 Validation Accuracy: 0.868600
Epoch 59, CIFAR-10 Batch 20:  Loss:     0.2340 Validation Accuracy: 0.877600
Epoch 59, CIFAR-10 Batch 21:  Loss:     0.1450 Validation Accuracy: 0.881200
Epoch 59, CIFAR-10 Batch 22:  Loss:     0.1760 Validation Accuracy: 0.874400
Epoch 59, CIFAR-10 Batch 23:  Loss:     0.1495 Validation Accuracy: 0.889400
Epoch 59, CIFAR-10 Batch 24:  Loss:     0.1965 Validation Accuracy: 0.884400
Epoch 59, CIFAR-10 Batch 25:  Loss:     0.1641 Validation Accuracy: 0.878800
Epoch 59, CIFAR-10 Batch 26:  Loss:     0.1723 Validation Accuracy: 0.878000
Epoch 59, CIFAR-10 Batch 27:  Loss:     0.1353 Validation Accuracy: 0.883200
Epoch 59, CIFAR-10 Batch 28:  Loss:     0.3045 Validation Accuracy: 0.889200
Epoch 59, CIFAR-10 Batch 29:  Loss:     0.1598 Validation Accuracy: 0.874800
Epoch 59, CIFAR-10 Batch 30:  Loss:     0.1354 Validation Accuracy: 0.873600
Epoch 59, CIFAR-10 Batch 31:  Loss:     0.1382 Validation Accuracy: 0.877000
Epoch 59, CIFAR-10 Batch 32:  Loss:     0.1404 Validation Accuracy: 0.879400
Epoch 59, CIFAR-10 Batch 33:  Loss:     0.2157 Validation Accuracy: 0.877600
Epoch 59, CIFAR-10 Batch 34:  Loss:     0.2377 Validation Accuracy: 0.866200
Epoch 59, CIFAR-10 Batch 35:  Loss:     0.2104 Validation Accuracy: 0.876400
Epoch 59, CIFAR-10 Batch 36:  Loss:     0.2696 Validation Accuracy: 0.881200
Epoch 59, CIFAR-10 Batch 37:  Loss:     0.1700 Validation Accuracy: 0.876200
Epoch 59, CIFAR-10 Batch 38:  Loss:     0.1323 Validation Accuracy: 0.884600
Epoch 59, CIFAR-10 Batch 39:  Loss:     0.1332 Validation Accuracy: 0.882400
Epoch 59, CIFAR-10 Batch 40:  Loss:     0.1981 Validation Accuracy: 0.879400
Epoch 59, CIFAR-10 Batch 41:  Loss:     0.1555 Validation Accuracy: 0.872400
Epoch 59, CIFAR-10 Batch 42:  Loss:     0.1932 Validation Accuracy: 0.874000
Epoch 59, CIFAR-10 Batch 43:  Loss:     0.2457 Validation Accuracy: 0.880000
Epoch 59, CIFAR-10 Batch 44:  Loss:     0.1903 Validation Accuracy: 0.877600
Epoch 59, CIFAR-10 Batch 45:  Loss:     0.1461 Validation Accuracy: 0.877400
Epoch 59, CIFAR-10 Batch 46:  Loss:     0.1510 Validation Accuracy: 0.872000
Epoch 59, CIFAR-10 Batch 47:  Loss:     0.2026 Validation Accuracy: 0.886600
Epoch 59, CIFAR-10 Batch 48:  Loss:     0.1512 Validation Accuracy: 0.871200
Epoch 59, CIFAR-10 Batch 49:  Loss:     0.2174 Validation Accuracy: 0.879400
Epoch 59, CIFAR-10 Batch 50:  Loss:     0.1656 Validation Accuracy: 0.865400
Epoch 60, CIFAR-10 Batch 1:  Loss:     0.1443 Validation Accuracy: 0.870800
Epoch 60, CIFAR-10 Batch 2:  Loss:     0.1699 Validation Accuracy: 0.878800
Epoch 60, CIFAR-10 Batch 3:  Loss:     0.1855 Validation Accuracy: 0.883000
Epoch 60, CIFAR-10 Batch 4:  Loss:     0.1505 Validation Accuracy: 0.871000
Epoch 60, CIFAR-10 Batch 5:  Loss:     0.1655 Validation Accuracy: 0.879800
Epoch 60, CIFAR-10 Batch 6:  Loss:     0.2830 Validation Accuracy: 0.880400
Epoch 60, CIFAR-10 Batch 7:  Loss:     0.2247 Validation Accuracy: 0.869800
Epoch 60, CIFAR-10 Batch 8:  Loss:     0.1960 Validation Accuracy: 0.869800
Epoch 60, CIFAR-10 Batch 9:  Loss:     0.1498 Validation Accuracy: 0.877200
Epoch 60, CIFAR-10 Batch 10:  Loss:     0.1368 Validation Accuracy: 0.874200
Epoch 60, CIFAR-10 Batch 11:  Loss:     0.2058 Validation Accuracy: 0.877600
Epoch 60, CIFAR-10 Batch 12:  Loss:     0.1823 Validation Accuracy: 0.867000
Epoch 60, CIFAR-10 Batch 13:  Loss:     0.1503 Validation Accuracy: 0.874800
Epoch 60, CIFAR-10 Batch 14:  Loss:     0.1718 Validation Accuracy: 0.886800
Epoch 60, CIFAR-10 Batch 15:  Loss:     0.1793 Validation Accuracy: 0.880200
Epoch 60, CIFAR-10 Batch 16:  Loss:     0.1699 Validation Accuracy: 0.865800
Epoch 60, CIFAR-10 Batch 17:  Loss:     0.2114 Validation Accuracy: 0.873800
Epoch 60, CIFAR-10 Batch 18:  Loss:     0.1476 Validation Accuracy: 0.869000
Epoch 60, CIFAR-10 Batch 19:  Loss:     0.1382 Validation Accuracy: 0.880600
Epoch 60, CIFAR-10 Batch 20:  Loss:     0.2016 Validation Accuracy: 0.869800
Epoch 60, CIFAR-10 Batch 21:  Loss:     0.1337 Validation Accuracy: 0.877000
Epoch 60, CIFAR-10 Batch 22:  Loss:     0.1725 Validation Accuracy: 0.872400
Epoch 60, CIFAR-10 Batch 23:  Loss:     0.1724 Validation Accuracy: 0.871800
Epoch 60, CIFAR-10 Batch 24:  Loss:     0.2091 Validation Accuracy: 0.879400
Epoch 60, CIFAR-10 Batch 25:  Loss:     0.1789 Validation Accuracy: 0.871800
Epoch 60, CIFAR-10 Batch 26:  Loss:     0.1951 Validation Accuracy: 0.880800
Epoch 60, CIFAR-10 Batch 27:  Loss:     0.1448 Validation Accuracy: 0.871400
Epoch 60, CIFAR-10 Batch 28:  Loss:     0.2954 Validation Accuracy: 0.875200
Epoch 60, CIFAR-10 Batch 29:  Loss:     0.1650 Validation Accuracy: 0.886800
Epoch 60, CIFAR-10 Batch 30:  Loss:     0.1421 Validation Accuracy: 0.877600
Epoch 60, CIFAR-10 Batch 31:  Loss:     0.1658 Validation Accuracy: 0.868000
Epoch 60, CIFAR-10 Batch 32:  Loss:     0.1496 Validation Accuracy: 0.875200
Epoch 60, CIFAR-10 Batch 33:  Loss:     0.2254 Validation Accuracy: 0.865800
Epoch 60, CIFAR-10 Batch 34:  Loss:     0.2258 Validation Accuracy: 0.880800
Epoch 60, CIFAR-10 Batch 35:  Loss:     0.2359 Validation Accuracy: 0.873200
Epoch 60, CIFAR-10 Batch 36:  Loss:     0.2584 Validation Accuracy: 0.874400
Epoch 60, CIFAR-10 Batch 37:  Loss:     0.1561 Validation Accuracy: 0.860200
Epoch 60, CIFAR-10 Batch 38:  Loss:     0.1332 Validation Accuracy: 0.872600
Epoch 60, CIFAR-10 Batch 39:  Loss:     0.1326 Validation Accuracy: 0.874800
Epoch 60, CIFAR-10 Batch 40:  Loss:     0.1776 Validation Accuracy: 0.873600
Epoch 60, CIFAR-10 Batch 41:  Loss:     0.2071 Validation Accuracy: 0.882800
Epoch 60, CIFAR-10 Batch 42:  Loss:     0.1600 Validation Accuracy: 0.877800
Epoch 60, CIFAR-10 Batch 43:  Loss:     0.2870 Validation Accuracy: 0.883600
Epoch 60, CIFAR-10 Batch 44:  Loss:     0.2137 Validation Accuracy: 0.878800
Epoch 60, CIFAR-10 Batch 45:  Loss:     0.1840 Validation Accuracy: 0.878400
Epoch 60, CIFAR-10 Batch 46:  Loss:     0.1567 Validation Accuracy: 0.878000
Epoch 60, CIFAR-10 Batch 47:  Loss:     0.1782 Validation Accuracy: 0.882000
Epoch 60, CIFAR-10 Batch 48:  Loss:     0.1528 Validation Accuracy: 0.877800
Epoch 60, CIFAR-10 Batch 49:  Loss:     0.2483 Validation Accuracy: 0.873000
Epoch 60, CIFAR-10 Batch 50:  Loss:     0.1602 Validation Accuracy: 0.883000
Epoch 61, CIFAR-10 Batch 1:  Loss:     0.1565 Validation Accuracy: 0.870200
Epoch 61, CIFAR-10 Batch 2:  Loss:     0.1499 Validation Accuracy: 0.877400
Epoch 61, CIFAR-10 Batch 3:  Loss:     0.1573 Validation Accuracy: 0.872800
Epoch 61, CIFAR-10 Batch 4:  Loss:     0.1512 Validation Accuracy: 0.877800
Epoch 61, CIFAR-10 Batch 5:  Loss:     0.1793 Validation Accuracy: 0.879000
Epoch 61, CIFAR-10 Batch 6:  Loss:     0.2802 Validation Accuracy: 0.879200
Epoch 61, CIFAR-10 Batch 7:  Loss:     0.1479 Validation Accuracy: 0.879400
Epoch 61, CIFAR-10 Batch 8:  Loss:     0.1808 Validation Accuracy: 0.884400
Epoch 61, CIFAR-10 Batch 9:  Loss:     0.1532 Validation Accuracy: 0.880600
Epoch 61, CIFAR-10 Batch 10:  Loss:     0.1400 Validation Accuracy: 0.879800
Epoch 61, CIFAR-10 Batch 11:  Loss:     0.1881 Validation Accuracy: 0.874800
Epoch 61, CIFAR-10 Batch 12:  Loss:     0.1742 Validation Accuracy: 0.882200
Epoch 61, CIFAR-10 Batch 13:  Loss:     0.1656 Validation Accuracy: 0.869200
Epoch 61, CIFAR-10 Batch 14:  Loss:     0.1679 Validation Accuracy: 0.873800
Epoch 61, CIFAR-10 Batch 15:  Loss:     0.1669 Validation Accuracy: 0.871600
Epoch 61, CIFAR-10 Batch 16:  Loss:     0.1732 Validation Accuracy: 0.877000
Epoch 61, CIFAR-10 Batch 17:  Loss:     0.2011 Validation Accuracy: 0.884800
Epoch 61, CIFAR-10 Batch 18:  Loss:     0.1455 Validation Accuracy: 0.871200
Epoch 61, CIFAR-10 Batch 19:  Loss:     0.1426 Validation Accuracy: 0.871000
Epoch 61, CIFAR-10 Batch 20:  Loss:     0.2142 Validation Accuracy: 0.877400
Epoch 61, CIFAR-10 Batch 21:  Loss:     0.1746 Validation Accuracy: 0.872000
Epoch 61, CIFAR-10 Batch 22:  Loss:     0.1693 Validation Accuracy: 0.866400
Epoch 61, CIFAR-10 Batch 23:  Loss:     0.1691 Validation Accuracy: 0.868200
Epoch 61, CIFAR-10 Batch 24:  Loss:     0.1985 Validation Accuracy: 0.873400
Epoch 61, CIFAR-10 Batch 25:  Loss:     0.1911 Validation Accuracy: 0.873200
Epoch 61, CIFAR-10 Batch 26:  Loss:     0.2051 Validation Accuracy: 0.881000
Epoch 61, CIFAR-10 Batch 27:  Loss:     0.1316 Validation Accuracy: 0.870800
Epoch 61, CIFAR-10 Batch 28:  Loss:     0.2337 Validation Accuracy: 0.889400
Epoch 61, CIFAR-10 Batch 29:  Loss:     0.1634 Validation Accuracy: 0.876600
Epoch 61, CIFAR-10 Batch 30:  Loss:     0.1292 Validation Accuracy: 0.870000
Epoch 61, CIFAR-10 Batch 31:  Loss:     0.1631 Validation Accuracy: 0.874000
Epoch 61, CIFAR-10 Batch 32:  Loss:     0.1520 Validation Accuracy: 0.883200
Epoch 61, CIFAR-10 Batch 33:  Loss:     0.2392 Validation Accuracy: 0.873600
Epoch 61, CIFAR-10 Batch 34:  Loss:     0.3142 Validation Accuracy: 0.868200
Epoch 61, CIFAR-10 Batch 35:  Loss:     0.2313 Validation Accuracy: 0.877400
Epoch 61, CIFAR-10 Batch 36:  Loss:     0.2482 Validation Accuracy: 0.875000
Epoch 61, CIFAR-10 Batch 37:  Loss:     0.1563 Validation Accuracy: 0.875000
Epoch 61, CIFAR-10 Batch 38:  Loss:     0.1339 Validation Accuracy: 0.879600
Epoch 61, CIFAR-10 Batch 39:  Loss:     0.1372 Validation Accuracy: 0.888000
Epoch 61, CIFAR-10 Batch 40:  Loss:     0.2031 Validation Accuracy: 0.873200
Epoch 61, CIFAR-10 Batch 41:  Loss:     0.1602 Validation Accuracy: 0.870600
Epoch 61, CIFAR-10 Batch 42:  Loss:     0.1638 Validation Accuracy: 0.880200
Epoch 61, CIFAR-10 Batch 43:  Loss:     0.2883 Validation Accuracy: 0.874800
Epoch 61, CIFAR-10 Batch 44:  Loss:     0.1756 Validation Accuracy: 0.859400
Epoch 61, CIFAR-10 Batch 45:  Loss:     0.1480 Validation Accuracy: 0.885200
Epoch 61, CIFAR-10 Batch 46:  Loss:     0.1765 Validation Accuracy: 0.872000
Epoch 61, CIFAR-10 Batch 47:  Loss:     0.1671 Validation Accuracy: 0.884400
Epoch 61, CIFAR-10 Batch 48:  Loss:     0.1747 Validation Accuracy: 0.884800
Epoch 61, CIFAR-10 Batch 49:  Loss:     0.2098 Validation Accuracy: 0.883400
Epoch 61, CIFAR-10 Batch 50:  Loss:     0.1592 Validation Accuracy: 0.884000
Epoch 62, CIFAR-10 Batch 1:  Loss:     0.1485 Validation Accuracy: 0.878800
Epoch 62, CIFAR-10 Batch 2:  Loss:     0.1554 Validation Accuracy: 0.874600
Epoch 62, CIFAR-10 Batch 3:  Loss:     0.1679 Validation Accuracy: 0.868800
Epoch 62, CIFAR-10 Batch 4:  Loss:     0.1592 Validation Accuracy: 0.883800
Epoch 62, CIFAR-10 Batch 5:  Loss:     0.1721 Validation Accuracy: 0.882600
Epoch 62, CIFAR-10 Batch 6:  Loss:     0.3025 Validation Accuracy: 0.882000
Epoch 62, CIFAR-10 Batch 7:  Loss:     0.1498 Validation Accuracy: 0.862600
Epoch 62, CIFAR-10 Batch 8:  Loss:     0.1924 Validation Accuracy: 0.881600
Epoch 62, CIFAR-10 Batch 9:  Loss:     0.1610 Validation Accuracy: 0.888000
Epoch 62, CIFAR-10 Batch 10:  Loss:     0.1477 Validation Accuracy: 0.856600
Epoch 62, CIFAR-10 Batch 11:  Loss:     0.1651 Validation Accuracy: 0.878200
Epoch 62, CIFAR-10 Batch 12:  Loss:     0.1733 Validation Accuracy: 0.863000
Epoch 62, CIFAR-10 Batch 13:  Loss:     0.2196 Validation Accuracy: 0.886400
Epoch 62, CIFAR-10 Batch 14:  Loss:     0.1764 Validation Accuracy: 0.863400
Epoch 62, CIFAR-10 Batch 15:  Loss:     0.1979 Validation Accuracy: 0.877200
Epoch 62, CIFAR-10 Batch 16:  Loss:     0.1576 Validation Accuracy: 0.858200
Epoch 62, CIFAR-10 Batch 17:  Loss:     0.2295 Validation Accuracy: 0.879400
Epoch 62, CIFAR-10 Batch 18:  Loss:     0.1620 Validation Accuracy: 0.865400
Epoch 62, CIFAR-10 Batch 19:  Loss:     0.1306 Validation Accuracy: 0.877800
Epoch 62, CIFAR-10 Batch 20:  Loss:     0.2414 Validation Accuracy: 0.885400
Epoch 62, CIFAR-10 Batch 21:  Loss:     0.1388 Validation Accuracy: 0.881200
Epoch 62, CIFAR-10 Batch 22:  Loss:     0.1930 Validation Accuracy: 0.877800
Epoch 62, CIFAR-10 Batch 23:  Loss:     0.1609 Validation Accuracy: 0.874600
Epoch 62, CIFAR-10 Batch 24:  Loss:     0.1775 Validation Accuracy: 0.883800
Epoch 62, CIFAR-10 Batch 25:  Loss:     0.2782 Validation Accuracy: 0.882000
Epoch 62, CIFAR-10 Batch 26:  Loss:     0.1594 Validation Accuracy: 0.883400
Epoch 62, CIFAR-10 Batch 27:  Loss:     0.1448 Validation Accuracy: 0.871000
Epoch 62, CIFAR-10 Batch 28:  Loss:     0.2478 Validation Accuracy: 0.871800
Epoch 62, CIFAR-10 Batch 29:  Loss:     0.1391 Validation Accuracy: 0.874600
Epoch 62, CIFAR-10 Batch 30:  Loss:     0.1314 Validation Accuracy: 0.860600
Epoch 62, CIFAR-10 Batch 31:  Loss:     0.1557 Validation Accuracy: 0.881800
Epoch 62, CIFAR-10 Batch 32:  Loss:     0.1549 Validation Accuracy: 0.885000
Epoch 62, CIFAR-10 Batch 33:  Loss:     0.2295 Validation Accuracy: 0.874200
Epoch 62, CIFAR-10 Batch 34:  Loss:     0.2663 Validation Accuracy: 0.874600
Epoch 62, CIFAR-10 Batch 35:  Loss:     0.2516 Validation Accuracy: 0.873400
Epoch 62, CIFAR-10 Batch 36:  Loss:     0.2538 Validation Accuracy: 0.870800
Epoch 62, CIFAR-10 Batch 37:  Loss:     0.1581 Validation Accuracy: 0.867200
Epoch 62, CIFAR-10 Batch 38:  Loss:     0.1320 Validation Accuracy: 0.880800
Epoch 62, CIFAR-10 Batch 39:  Loss:     0.1303 Validation Accuracy: 0.870200
Epoch 62, CIFAR-10 Batch 40:  Loss:     0.1818 Validation Accuracy: 0.879200
Epoch 62, CIFAR-10 Batch 41:  Loss:     0.1744 Validation Accuracy: 0.875800
Epoch 62, CIFAR-10 Batch 42:  Loss:     0.1668 Validation Accuracy: 0.878200
Epoch 62, CIFAR-10 Batch 43:  Loss:     0.2742 Validation Accuracy: 0.883800
Epoch 62, CIFAR-10 Batch 44:  Loss:     0.1766 Validation Accuracy: 0.875600
Epoch 62, CIFAR-10 Batch 45:  Loss:     0.1427 Validation Accuracy: 0.886000
Epoch 62, CIFAR-10 Batch 46:  Loss:     0.1640 Validation Accuracy: 0.868800
Epoch 62, CIFAR-10 Batch 47:  Loss:     0.1652 Validation Accuracy: 0.885400
Epoch 62, CIFAR-10 Batch 48:  Loss:     0.1473 Validation Accuracy: 0.884600
Epoch 62, CIFAR-10 Batch 49:  Loss:     0.2313 Validation Accuracy: 0.870400
Epoch 62, CIFAR-10 Batch 50:  Loss:     0.1675 Validation Accuracy: 0.888000
Epoch 63, CIFAR-10 Batch 1:  Loss:     0.1356 Validation Accuracy: 0.881200
Epoch 63, CIFAR-10 Batch 2:  Loss:     0.1948 Validation Accuracy: 0.878800
Epoch 63, CIFAR-10 Batch 3:  Loss:     0.1455 Validation Accuracy: 0.889200
Epoch 63, CIFAR-10 Batch 4:  Loss:     0.1606 Validation Accuracy: 0.883800
Epoch 63, CIFAR-10 Batch 5:  Loss:     0.1821 Validation Accuracy: 0.881400
Epoch 63, CIFAR-10 Batch 6:  Loss:     0.2625 Validation Accuracy: 0.882600
Epoch 63, CIFAR-10 Batch 7:  Loss:     0.1476 Validation Accuracy: 0.863600
Epoch 63, CIFAR-10 Batch 8:  Loss:     0.1890 Validation Accuracy: 0.878400
Epoch 63, CIFAR-10 Batch 9:  Loss:     0.1605 Validation Accuracy: 0.882000
Epoch 63, CIFAR-10 Batch 10:  Loss:     0.1368 Validation Accuracy: 0.881400
Epoch 63, CIFAR-10 Batch 11:  Loss:     0.1433 Validation Accuracy: 0.879200
Epoch 63, CIFAR-10 Batch 12:  Loss:     0.1592 Validation Accuracy: 0.884400
Epoch 63, CIFAR-10 Batch 13:  Loss:     0.1740 Validation Accuracy: 0.885600
Epoch 63, CIFAR-10 Batch 14:  Loss:     0.1785 Validation Accuracy: 0.883400
Epoch 63, CIFAR-10 Batch 15:  Loss:     0.1634 Validation Accuracy: 0.877400
Epoch 63, CIFAR-10 Batch 16:  Loss:     0.1498 Validation Accuracy: 0.877800
Epoch 63, CIFAR-10 Batch 17:  Loss:     0.2156 Validation Accuracy: 0.878000
Epoch 63, CIFAR-10 Batch 18:  Loss:     0.1524 Validation Accuracy: 0.876400
Epoch 63, CIFAR-10 Batch 19:  Loss:     0.1332 Validation Accuracy: 0.876600
Epoch 63, CIFAR-10 Batch 20:  Loss:     0.2320 Validation Accuracy: 0.885800
Epoch 63, CIFAR-10 Batch 21:  Loss:     0.1373 Validation Accuracy: 0.889000
Epoch 63, CIFAR-10 Batch 22:  Loss:     0.1949 Validation Accuracy: 0.867600
Epoch 63, CIFAR-10 Batch 23:  Loss:     0.1601 Validation Accuracy: 0.882600
Epoch 63, CIFAR-10 Batch 24:  Loss:     0.1801 Validation Accuracy: 0.878200
Epoch 63, CIFAR-10 Batch 25:  Loss:     0.2530 Validation Accuracy: 0.866600
Epoch 63, CIFAR-10 Batch 26:  Loss:     0.1598 Validation Accuracy: 0.880800
Epoch 63, CIFAR-10 Batch 27:  Loss:     0.1291 Validation Accuracy: 0.874400
Epoch 63, CIFAR-10 Batch 28:  Loss:     0.2737 Validation Accuracy: 0.880400
Epoch 63, CIFAR-10 Batch 29:  Loss:     0.1555 Validation Accuracy: 0.877000
Epoch 63, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.872400
Epoch 63, CIFAR-10 Batch 31:  Loss:     0.1605 Validation Accuracy: 0.879200
Epoch 63, CIFAR-10 Batch 32:  Loss:     0.1725 Validation Accuracy: 0.874400
Epoch 63, CIFAR-10 Batch 33:  Loss:     0.2339 Validation Accuracy: 0.864200
Epoch 63, CIFAR-10 Batch 34:  Loss:     0.2656 Validation Accuracy: 0.869600
Epoch 63, CIFAR-10 Batch 35:  Loss:     0.2490 Validation Accuracy: 0.872800
Epoch 63, CIFAR-10 Batch 36:  Loss:     0.2515 Validation Accuracy: 0.859000
Epoch 63, CIFAR-10 Batch 37:  Loss:     0.1491 Validation Accuracy: 0.859200
Epoch 63, CIFAR-10 Batch 38:  Loss:     0.1448 Validation Accuracy: 0.883400
Epoch 63, CIFAR-10 Batch 39:  Loss:     0.1360 Validation Accuracy: 0.877200
Epoch 63, CIFAR-10 Batch 40:  Loss:     0.1514 Validation Accuracy: 0.868000
Epoch 63, CIFAR-10 Batch 41:  Loss:     0.1789 Validation Accuracy: 0.866200
Epoch 63, CIFAR-10 Batch 42:  Loss:     0.1831 Validation Accuracy: 0.873600
Epoch 63, CIFAR-10 Batch 43:  Loss:     0.2883 Validation Accuracy: 0.877200
Epoch 63, CIFAR-10 Batch 44:  Loss:     0.2134 Validation Accuracy: 0.874600
Epoch 63, CIFAR-10 Batch 45:  Loss:     0.1427 Validation Accuracy: 0.883000
Epoch 63, CIFAR-10 Batch 46:  Loss:     0.1775 Validation Accuracy: 0.878600
Epoch 63, CIFAR-10 Batch 47:  Loss:     0.1727 Validation Accuracy: 0.879000
Epoch 63, CIFAR-10 Batch 48:  Loss:     0.1579 Validation Accuracy: 0.855000
Epoch 63, CIFAR-10 Batch 49:  Loss:     0.2136 Validation Accuracy: 0.867600
Epoch 63, CIFAR-10 Batch 50:  Loss:     0.1660 Validation Accuracy: 0.884400
Epoch 64, CIFAR-10 Batch 1:  Loss:     0.1565 Validation Accuracy: 0.875200
Epoch 64, CIFAR-10 Batch 2:  Loss:     0.1625 Validation Accuracy: 0.878800
Epoch 64, CIFAR-10 Batch 3:  Loss:     0.1371 Validation Accuracy: 0.888000
Epoch 64, CIFAR-10 Batch 4:  Loss:     0.1562 Validation Accuracy: 0.882000
Epoch 64, CIFAR-10 Batch 5:  Loss:     0.1654 Validation Accuracy: 0.881400
Epoch 64, CIFAR-10 Batch 6:  Loss:     0.2335 Validation Accuracy: 0.883600
Epoch 64, CIFAR-10 Batch 7:  Loss:     0.1403 Validation Accuracy: 0.867200
Epoch 64, CIFAR-10 Batch 8:  Loss:     0.1739 Validation Accuracy: 0.879800
Epoch 64, CIFAR-10 Batch 9:  Loss:     0.1442 Validation Accuracy: 0.875800
Epoch 64, CIFAR-10 Batch 10:  Loss:     0.1310 Validation Accuracy: 0.879400
Epoch 64, CIFAR-10 Batch 11:  Loss:     0.1430 Validation Accuracy: 0.876800
Epoch 64, CIFAR-10 Batch 12:  Loss:     0.1680 Validation Accuracy: 0.865600
Epoch 64, CIFAR-10 Batch 13:  Loss:     0.1602 Validation Accuracy: 0.881200
Epoch 64, CIFAR-10 Batch 14:  Loss:     0.1749 Validation Accuracy: 0.879200
Epoch 64, CIFAR-10 Batch 15:  Loss:     0.1628 Validation Accuracy: 0.872000
Epoch 64, CIFAR-10 Batch 16:  Loss:     0.2097 Validation Accuracy: 0.869400
Epoch 64, CIFAR-10 Batch 17:  Loss:     0.2060 Validation Accuracy: 0.879600
Epoch 64, CIFAR-10 Batch 18:  Loss:     0.1372 Validation Accuracy: 0.874000
Epoch 64, CIFAR-10 Batch 19:  Loss:     0.1411 Validation Accuracy: 0.877600
Epoch 64, CIFAR-10 Batch 20:  Loss:     0.1997 Validation Accuracy: 0.883400
Epoch 64, CIFAR-10 Batch 21:  Loss:     0.1803 Validation Accuracy: 0.880400
Epoch 64, CIFAR-10 Batch 22:  Loss:     0.2366 Validation Accuracy: 0.878600
Epoch 64, CIFAR-10 Batch 23:  Loss:     0.1652 Validation Accuracy: 0.875200
Epoch 64, CIFAR-10 Batch 24:  Loss:     0.1977 Validation Accuracy: 0.891200
Epoch 64, CIFAR-10 Batch 25:  Loss:     0.2293 Validation Accuracy: 0.865600
Epoch 64, CIFAR-10 Batch 26:  Loss:     0.1671 Validation Accuracy: 0.869600
Epoch 64, CIFAR-10 Batch 27:  Loss:     0.1255 Validation Accuracy: 0.866400
Epoch 64, CIFAR-10 Batch 28:  Loss:     0.2603 Validation Accuracy: 0.880200
Epoch 64, CIFAR-10 Batch 29:  Loss:     0.1532 Validation Accuracy: 0.884200
Epoch 64, CIFAR-10 Batch 30:  Loss:     0.1369 Validation Accuracy: 0.871600
Epoch 64, CIFAR-10 Batch 31:  Loss:     0.1499 Validation Accuracy: 0.872800
Epoch 64, CIFAR-10 Batch 32:  Loss:     0.1576 Validation Accuracy: 0.880400
Epoch 64, CIFAR-10 Batch 33:  Loss:     0.2386 Validation Accuracy: 0.870400
Epoch 64, CIFAR-10 Batch 34:  Loss:     0.2685 Validation Accuracy: 0.878000
Epoch 64, CIFAR-10 Batch 35:  Loss:     0.1918 Validation Accuracy: 0.881200
Epoch 64, CIFAR-10 Batch 36:  Loss:     0.2560 Validation Accuracy: 0.872400
Epoch 64, CIFAR-10 Batch 37:  Loss:     0.1460 Validation Accuracy: 0.859200
Epoch 64, CIFAR-10 Batch 38:  Loss:     0.1298 Validation Accuracy: 0.878800
Epoch 64, CIFAR-10 Batch 39:  Loss:     0.1362 Validation Accuracy: 0.860000
Epoch 64, CIFAR-10 Batch 40:  Loss:     0.1967 Validation Accuracy: 0.852600
Epoch 64, CIFAR-10 Batch 41:  Loss:     0.1608 Validation Accuracy: 0.883200
Epoch 64, CIFAR-10 Batch 42:  Loss:     0.1736 Validation Accuracy: 0.882800
Epoch 64, CIFAR-10 Batch 43:  Loss:     0.2280 Validation Accuracy: 0.872800
Epoch 64, CIFAR-10 Batch 44:  Loss:     0.1460 Validation Accuracy: 0.884200
Epoch 64, CIFAR-10 Batch 45:  Loss:     0.1594 Validation Accuracy: 0.884600
Epoch 64, CIFAR-10 Batch 46:  Loss:     0.1723 Validation Accuracy: 0.888200
Epoch 64, CIFAR-10 Batch 47:  Loss:     0.1827 Validation Accuracy: 0.873600
Epoch 64, CIFAR-10 Batch 48:  Loss:     0.1665 Validation Accuracy: 0.881400
Epoch 64, CIFAR-10 Batch 49:  Loss:     0.2381 Validation Accuracy: 0.882800
Epoch 64, CIFAR-10 Batch 50:  Loss:     0.1608 Validation Accuracy: 0.878800
Epoch 65, CIFAR-10 Batch 1:  Loss:     0.1503 Validation Accuracy: 0.884400
Epoch 65, CIFAR-10 Batch 2:  Loss:     0.2045 Validation Accuracy: 0.879200
Epoch 65, CIFAR-10 Batch 3:  Loss:     0.1400 Validation Accuracy: 0.890400
Epoch 65, CIFAR-10 Batch 4:  Loss:     0.1459 Validation Accuracy: 0.884400
Epoch 65, CIFAR-10 Batch 5:  Loss:     0.1680 Validation Accuracy: 0.886000
Epoch 65, CIFAR-10 Batch 6:  Loss:     0.2382 Validation Accuracy: 0.875000
Epoch 65, CIFAR-10 Batch 7:  Loss:     0.1546 Validation Accuracy: 0.876200
Epoch 65, CIFAR-10 Batch 8:  Loss:     0.2117 Validation Accuracy: 0.882600
Epoch 65, CIFAR-10 Batch 9:  Loss:     0.1544 Validation Accuracy: 0.877600
Epoch 65, CIFAR-10 Batch 10:  Loss:     0.1301 Validation Accuracy: 0.877000
Epoch 65, CIFAR-10 Batch 11:  Loss:     0.1683 Validation Accuracy: 0.883800
Epoch 65, CIFAR-10 Batch 12:  Loss:     0.1530 Validation Accuracy: 0.886400
Epoch 65, CIFAR-10 Batch 13:  Loss:     0.1531 Validation Accuracy: 0.872800
Epoch 65, CIFAR-10 Batch 14:  Loss:     0.1580 Validation Accuracy: 0.880400
Epoch 65, CIFAR-10 Batch 15:  Loss:     0.1506 Validation Accuracy: 0.878800
Epoch 65, CIFAR-10 Batch 16:  Loss:     0.1566 Validation Accuracy: 0.881800
Epoch 65, CIFAR-10 Batch 17:  Loss:     0.1961 Validation Accuracy: 0.874400
Epoch 65, CIFAR-10 Batch 18:  Loss:     0.1387 Validation Accuracy: 0.878600
Epoch 65, CIFAR-10 Batch 19:  Loss:     0.1463 Validation Accuracy: 0.879200
Epoch 65, CIFAR-10 Batch 20:  Loss:     0.1876 Validation Accuracy: 0.885400
Epoch 65, CIFAR-10 Batch 21:  Loss:     0.1484 Validation Accuracy: 0.880200
Epoch 65, CIFAR-10 Batch 22:  Loss:     0.1752 Validation Accuracy: 0.879800
Epoch 65, CIFAR-10 Batch 23:  Loss:     0.1688 Validation Accuracy: 0.889600
Epoch 65, CIFAR-10 Batch 24:  Loss:     0.1847 Validation Accuracy: 0.888800
Epoch 65, CIFAR-10 Batch 25:  Loss:     0.1801 Validation Accuracy: 0.877800
Epoch 65, CIFAR-10 Batch 26:  Loss:     0.1873 Validation Accuracy: 0.884600
Epoch 65, CIFAR-10 Batch 27:  Loss:     0.1287 Validation Accuracy: 0.876600
Epoch 65, CIFAR-10 Batch 28:  Loss:     0.2313 Validation Accuracy: 0.874200
Epoch 65, CIFAR-10 Batch 29:  Loss:     0.1633 Validation Accuracy: 0.881400
Epoch 65, CIFAR-10 Batch 30:  Loss:     0.1424 Validation Accuracy: 0.879000
Epoch 65, CIFAR-10 Batch 31:  Loss:     0.1558 Validation Accuracy: 0.877400
Epoch 65, CIFAR-10 Batch 32:  Loss:     0.1416 Validation Accuracy: 0.872400
Epoch 65, CIFAR-10 Batch 33:  Loss:     0.2895 Validation Accuracy: 0.881600
Epoch 65, CIFAR-10 Batch 34:  Loss:     0.2196 Validation Accuracy: 0.866600
Epoch 65, CIFAR-10 Batch 35:  Loss:     0.2696 Validation Accuracy: 0.874200
Epoch 65, CIFAR-10 Batch 36:  Loss:     0.2309 Validation Accuracy: 0.857400
Epoch 65, CIFAR-10 Batch 37:  Loss:     0.1650 Validation Accuracy: 0.872000
Epoch 65, CIFAR-10 Batch 38:  Loss:     0.1386 Validation Accuracy: 0.867400
Epoch 65, CIFAR-10 Batch 39:  Loss:     0.1367 Validation Accuracy: 0.878800
Epoch 65, CIFAR-10 Batch 40:  Loss:     0.1572 Validation Accuracy: 0.872200
Epoch 65, CIFAR-10 Batch 41:  Loss:     0.2001 Validation Accuracy: 0.878400
Epoch 65, CIFAR-10 Batch 42:  Loss:     0.1779 Validation Accuracy: 0.871800
Epoch 65, CIFAR-10 Batch 43:  Loss:     0.2813 Validation Accuracy: 0.875000
Epoch 65, CIFAR-10 Batch 44:  Loss:     0.1691 Validation Accuracy: 0.860400
Epoch 65, CIFAR-10 Batch 45:  Loss:     0.1817 Validation Accuracy: 0.885200
Epoch 65, CIFAR-10 Batch 46:  Loss:     0.2046 Validation Accuracy: 0.874000
Epoch 65, CIFAR-10 Batch 47:  Loss:     0.1566 Validation Accuracy: 0.890800
Epoch 65, CIFAR-10 Batch 48:  Loss:     0.1444 Validation Accuracy: 0.882400
Epoch 65, CIFAR-10 Batch 49:  Loss:     0.2180 Validation Accuracy: 0.885400
Epoch 65, CIFAR-10 Batch 50:  Loss:     0.1675 Validation Accuracy: 0.882400
Epoch 66, CIFAR-10 Batch 1:  Loss:     0.1525 Validation Accuracy: 0.880600
Epoch 66, CIFAR-10 Batch 2:  Loss:     0.1622 Validation Accuracy: 0.875400
Epoch 66, CIFAR-10 Batch 3:  Loss:     0.1345 Validation Accuracy: 0.879400
Epoch 66, CIFAR-10 Batch 4:  Loss:     0.1360 Validation Accuracy: 0.881800
Epoch 66, CIFAR-10 Batch 5:  Loss:     0.1876 Validation Accuracy: 0.883200
Epoch 66, CIFAR-10 Batch 6:  Loss:     0.3027 Validation Accuracy: 0.887000
Epoch 66, CIFAR-10 Batch 7:  Loss:     0.1450 Validation Accuracy: 0.876400
Epoch 66, CIFAR-10 Batch 8:  Loss:     0.1764 Validation Accuracy: 0.893600
Epoch 66, CIFAR-10 Batch 9:  Loss:     0.1708 Validation Accuracy: 0.881200
Epoch 66, CIFAR-10 Batch 10:  Loss:     0.1311 Validation Accuracy: 0.890000
Epoch 66, CIFAR-10 Batch 11:  Loss:     0.1657 Validation Accuracy: 0.881400
Epoch 66, CIFAR-10 Batch 12:  Loss:     0.1504 Validation Accuracy: 0.872400
Epoch 66, CIFAR-10 Batch 13:  Loss:     0.1789 Validation Accuracy: 0.876800
Epoch 66, CIFAR-10 Batch 14:  Loss:     0.1876 Validation Accuracy: 0.866000
Epoch 66, CIFAR-10 Batch 15:  Loss:     0.1464 Validation Accuracy: 0.885400
Epoch 66, CIFAR-10 Batch 16:  Loss:     0.1848 Validation Accuracy: 0.864400
Epoch 66, CIFAR-10 Batch 17:  Loss:     0.1854 Validation Accuracy: 0.873000
Epoch 66, CIFAR-10 Batch 18:  Loss:     0.1566 Validation Accuracy: 0.861800
Epoch 66, CIFAR-10 Batch 19:  Loss:     0.1402 Validation Accuracy: 0.879200
Epoch 66, CIFAR-10 Batch 20:  Loss:     0.2118 Validation Accuracy: 0.888000
Epoch 66, CIFAR-10 Batch 21:  Loss:     0.1308 Validation Accuracy: 0.876200
Epoch 66, CIFAR-10 Batch 22:  Loss:     0.1769 Validation Accuracy: 0.878600
Epoch 66, CIFAR-10 Batch 23:  Loss:     0.1629 Validation Accuracy: 0.882600
Epoch 66, CIFAR-10 Batch 24:  Loss:     0.1813 Validation Accuracy: 0.883400
Epoch 66, CIFAR-10 Batch 25:  Loss:     0.1741 Validation Accuracy: 0.880800
Epoch 66, CIFAR-10 Batch 26:  Loss:     0.2297 Validation Accuracy: 0.886000
Epoch 66, CIFAR-10 Batch 27:  Loss:     0.1335 Validation Accuracy: 0.859600
Epoch 66, CIFAR-10 Batch 28:  Loss:     0.2595 Validation Accuracy: 0.881800
Epoch 66, CIFAR-10 Batch 29:  Loss:     0.1534 Validation Accuracy: 0.852400
Epoch 66, CIFAR-10 Batch 30:  Loss:     0.1364 Validation Accuracy: 0.879200
Epoch 66, CIFAR-10 Batch 31:  Loss:     0.1360 Validation Accuracy: 0.885800
Epoch 66, CIFAR-10 Batch 32:  Loss:     0.1421 Validation Accuracy: 0.877000
Epoch 66, CIFAR-10 Batch 33:  Loss:     0.2434 Validation Accuracy: 0.881600
Epoch 66, CIFAR-10 Batch 34:  Loss:     0.2502 Validation Accuracy: 0.879600
Epoch 66, CIFAR-10 Batch 35:  Loss:     0.2899 Validation Accuracy: 0.886600
Epoch 66, CIFAR-10 Batch 36:  Loss:     0.2384 Validation Accuracy: 0.869000
Epoch 66, CIFAR-10 Batch 37:  Loss:     0.1671 Validation Accuracy: 0.860200
Epoch 66, CIFAR-10 Batch 38:  Loss:     0.1377 Validation Accuracy: 0.869000
Epoch 66, CIFAR-10 Batch 39:  Loss:     0.1346 Validation Accuracy: 0.884200
Epoch 66, CIFAR-10 Batch 40:  Loss:     0.1640 Validation Accuracy: 0.863600
Epoch 66, CIFAR-10 Batch 41:  Loss:     0.1581 Validation Accuracy: 0.877200
Epoch 66, CIFAR-10 Batch 42:  Loss:     0.1675 Validation Accuracy: 0.870200
Epoch 66, CIFAR-10 Batch 43:  Loss:     0.2436 Validation Accuracy: 0.883800
Epoch 66, CIFAR-10 Batch 44:  Loss:     0.1894 Validation Accuracy: 0.851400
Epoch 66, CIFAR-10 Batch 45:  Loss:     0.1345 Validation Accuracy: 0.885000
Epoch 66, CIFAR-10 Batch 46:  Loss:     0.1612 Validation Accuracy: 0.878800
Epoch 66, CIFAR-10 Batch 47:  Loss:     0.1565 Validation Accuracy: 0.877800
Epoch 66, CIFAR-10 Batch 48:  Loss:     0.1527 Validation Accuracy: 0.882200
Epoch 66, CIFAR-10 Batch 49:  Loss:     0.1750 Validation Accuracy: 0.875400
Epoch 66, CIFAR-10 Batch 50:  Loss:     0.1626 Validation Accuracy: 0.886200
Epoch 67, CIFAR-10 Batch 1:  Loss:     0.1636 Validation Accuracy: 0.881200
Epoch 67, CIFAR-10 Batch 2:  Loss:     0.1409 Validation Accuracy: 0.879600
Epoch 67, CIFAR-10 Batch 3:  Loss:     0.1467 Validation Accuracy: 0.884000
Epoch 67, CIFAR-10 Batch 4:  Loss:     0.1719 Validation Accuracy: 0.870600
Epoch 67, CIFAR-10 Batch 5:  Loss:     0.1646 Validation Accuracy: 0.873800
Epoch 67, CIFAR-10 Batch 6:  Loss:     0.2495 Validation Accuracy: 0.879200
Epoch 67, CIFAR-10 Batch 7:  Loss:     0.1421 Validation Accuracy: 0.862200
Epoch 67, CIFAR-10 Batch 8:  Loss:     0.2062 Validation Accuracy: 0.875000
Epoch 67, CIFAR-10 Batch 9:  Loss:     0.1626 Validation Accuracy: 0.882200
Epoch 67, CIFAR-10 Batch 10:  Loss:     0.1279 Validation Accuracy: 0.868800
Epoch 67, CIFAR-10 Batch 11:  Loss:     0.1608 Validation Accuracy: 0.875800
Epoch 67, CIFAR-10 Batch 12:  Loss:     0.1398 Validation Accuracy: 0.889400
Epoch 67, CIFAR-10 Batch 13:  Loss:     0.1796 Validation Accuracy: 0.877400
Epoch 67, CIFAR-10 Batch 14:  Loss:     0.1712 Validation Accuracy: 0.870600
Epoch 67, CIFAR-10 Batch 15:  Loss:     0.1730 Validation Accuracy: 0.882400
Epoch 67, CIFAR-10 Batch 16:  Loss:     0.1740 Validation Accuracy: 0.874200
Epoch 67, CIFAR-10 Batch 17:  Loss:     0.1905 Validation Accuracy: 0.880400
Epoch 67, CIFAR-10 Batch 18:  Loss:     0.1601 Validation Accuracy: 0.867800
Epoch 67, CIFAR-10 Batch 19:  Loss:     0.1342 Validation Accuracy: 0.864800
Epoch 67, CIFAR-10 Batch 20:  Loss:     0.2304 Validation Accuracy: 0.879400
Epoch 67, CIFAR-10 Batch 21:  Loss:     0.1421 Validation Accuracy: 0.884200
Epoch 67, CIFAR-10 Batch 22:  Loss:     0.1969 Validation Accuracy: 0.875600
Epoch 67, CIFAR-10 Batch 23:  Loss:     0.1878 Validation Accuracy: 0.874000
Epoch 67, CIFAR-10 Batch 24:  Loss:     0.2339 Validation Accuracy: 0.862200
Epoch 67, CIFAR-10 Batch 25:  Loss:     0.1835 Validation Accuracy: 0.872400
Epoch 67, CIFAR-10 Batch 26:  Loss:     0.1462 Validation Accuracy: 0.881400
Epoch 67, CIFAR-10 Batch 27:  Loss:     0.1303 Validation Accuracy: 0.860600
Epoch 67, CIFAR-10 Batch 28:  Loss:     0.2681 Validation Accuracy: 0.871200
Epoch 67, CIFAR-10 Batch 29:  Loss:     0.1480 Validation Accuracy: 0.874600
Epoch 67, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.880400
Epoch 67, CIFAR-10 Batch 31:  Loss:     0.1741 Validation Accuracy: 0.865000
Epoch 67, CIFAR-10 Batch 32:  Loss:     0.1396 Validation Accuracy: 0.883600
Epoch 67, CIFAR-10 Batch 33:  Loss:     0.2714 Validation Accuracy: 0.853400
Epoch 67, CIFAR-10 Batch 34:  Loss:     0.2616 Validation Accuracy: 0.869400
Epoch 67, CIFAR-10 Batch 35:  Loss:     0.2444 Validation Accuracy: 0.879000
Epoch 67, CIFAR-10 Batch 36:  Loss:     0.2353 Validation Accuracy: 0.870400
Epoch 67, CIFAR-10 Batch 37:  Loss:     0.1621 Validation Accuracy: 0.880000
Epoch 67, CIFAR-10 Batch 38:  Loss:     0.1366 Validation Accuracy: 0.877400
Epoch 67, CIFAR-10 Batch 39:  Loss:     0.1534 Validation Accuracy: 0.880600
Epoch 67, CIFAR-10 Batch 40:  Loss:     0.1561 Validation Accuracy: 0.871600
Epoch 67, CIFAR-10 Batch 41:  Loss:     0.1577 Validation Accuracy: 0.876400
Epoch 67, CIFAR-10 Batch 42:  Loss:     0.1959 Validation Accuracy: 0.872600
Epoch 67, CIFAR-10 Batch 43:  Loss:     0.2349 Validation Accuracy: 0.875000
Epoch 67, CIFAR-10 Batch 44:  Loss:     0.1375 Validation Accuracy: 0.864200
Epoch 67, CIFAR-10 Batch 45:  Loss:     0.1527 Validation Accuracy: 0.870200
Epoch 67, CIFAR-10 Batch 46:  Loss:     0.1667 Validation Accuracy: 0.878800
Epoch 67, CIFAR-10 Batch 47:  Loss:     0.1612 Validation Accuracy: 0.875800
Epoch 67, CIFAR-10 Batch 48:  Loss:     0.1579 Validation Accuracy: 0.871800
Epoch 67, CIFAR-10 Batch 49:  Loss:     0.2078 Validation Accuracy: 0.873400
Epoch 67, CIFAR-10 Batch 50:  Loss:     0.1636 Validation Accuracy: 0.881200
Epoch 68, CIFAR-10 Batch 1:  Loss:     0.1453 Validation Accuracy: 0.873600
Epoch 68, CIFAR-10 Batch 2:  Loss:     0.1384 Validation Accuracy: 0.885000
Epoch 68, CIFAR-10 Batch 3:  Loss:     0.1441 Validation Accuracy: 0.880400
Epoch 68, CIFAR-10 Batch 4:  Loss:     0.1553 Validation Accuracy: 0.880800
Epoch 68, CIFAR-10 Batch 5:  Loss:     0.1695 Validation Accuracy: 0.878000
Epoch 68, CIFAR-10 Batch 6:  Loss:     0.2704 Validation Accuracy: 0.866800
Epoch 68, CIFAR-10 Batch 7:  Loss:     0.1337 Validation Accuracy: 0.873200
Epoch 68, CIFAR-10 Batch 8:  Loss:     0.2395 Validation Accuracy: 0.886000
Epoch 68, CIFAR-10 Batch 9:  Loss:     0.1412 Validation Accuracy: 0.869800
Epoch 68, CIFAR-10 Batch 10:  Loss:     0.1350 Validation Accuracy: 0.881600
Epoch 68, CIFAR-10 Batch 11:  Loss:     0.2008 Validation Accuracy: 0.876000
Epoch 68, CIFAR-10 Batch 12:  Loss:     0.1621 Validation Accuracy: 0.875400
Epoch 68, CIFAR-10 Batch 13:  Loss:     0.1510 Validation Accuracy: 0.885000
Epoch 68, CIFAR-10 Batch 14:  Loss:     0.1697 Validation Accuracy: 0.878200
Epoch 68, CIFAR-10 Batch 15:  Loss:     0.1357 Validation Accuracy: 0.884200
Epoch 68, CIFAR-10 Batch 16:  Loss:     0.1583 Validation Accuracy: 0.890800
Epoch 68, CIFAR-10 Batch 17:  Loss:     0.1901 Validation Accuracy: 0.873800
Epoch 68, CIFAR-10 Batch 18:  Loss:     0.1608 Validation Accuracy: 0.882000
Epoch 68, CIFAR-10 Batch 19:  Loss:     0.1358 Validation Accuracy: 0.886400
Epoch 68, CIFAR-10 Batch 20:  Loss:     0.2049 Validation Accuracy: 0.877600
Epoch 68, CIFAR-10 Batch 21:  Loss:     0.1319 Validation Accuracy: 0.874400
Epoch 68, CIFAR-10 Batch 22:  Loss:     0.1706 Validation Accuracy: 0.881200
Epoch 68, CIFAR-10 Batch 23:  Loss:     0.1614 Validation Accuracy: 0.883000
Epoch 68, CIFAR-10 Batch 24:  Loss:     0.1587 Validation Accuracy: 0.892600
Epoch 68, CIFAR-10 Batch 25:  Loss:     0.1762 Validation Accuracy: 0.876600
Epoch 68, CIFAR-10 Batch 26:  Loss:     0.1579 Validation Accuracy: 0.877400
Epoch 68, CIFAR-10 Batch 27:  Loss:     0.1300 Validation Accuracy: 0.877000
Epoch 68, CIFAR-10 Batch 28:  Loss:     0.2431 Validation Accuracy: 0.884000
Epoch 68, CIFAR-10 Batch 29:  Loss:     0.1523 Validation Accuracy: 0.874000
Epoch 68, CIFAR-10 Batch 30:  Loss:     0.1278 Validation Accuracy: 0.875600
Epoch 68, CIFAR-10 Batch 31:  Loss:     0.1560 Validation Accuracy: 0.879000
Epoch 68, CIFAR-10 Batch 32:  Loss:     0.1536 Validation Accuracy: 0.877600
Epoch 68, CIFAR-10 Batch 33:  Loss:     0.2376 Validation Accuracy: 0.874600
Epoch 68, CIFAR-10 Batch 34:  Loss:     0.2538 Validation Accuracy: 0.862400
Epoch 68, CIFAR-10 Batch 35:  Loss:     0.2682 Validation Accuracy: 0.884200
Epoch 68, CIFAR-10 Batch 36:  Loss:     0.2415 Validation Accuracy: 0.876000
Epoch 68, CIFAR-10 Batch 37:  Loss:     0.1816 Validation Accuracy: 0.876800
Epoch 68, CIFAR-10 Batch 38:  Loss:     0.1482 Validation Accuracy: 0.880200
Epoch 68, CIFAR-10 Batch 39:  Loss:     0.1332 Validation Accuracy: 0.883000
Epoch 68, CIFAR-10 Batch 40:  Loss:     0.1434 Validation Accuracy: 0.869800
Epoch 68, CIFAR-10 Batch 41:  Loss:     0.2247 Validation Accuracy: 0.881200
Epoch 68, CIFAR-10 Batch 42:  Loss:     0.1702 Validation Accuracy: 0.876000
Epoch 68, CIFAR-10 Batch 43:  Loss:     0.2873 Validation Accuracy: 0.875600
Epoch 68, CIFAR-10 Batch 44:  Loss:     0.1779 Validation Accuracy: 0.875000
Epoch 68, CIFAR-10 Batch 45:  Loss:     0.1395 Validation Accuracy: 0.882200
Epoch 68, CIFAR-10 Batch 46:  Loss:     0.1655 Validation Accuracy: 0.887600
Epoch 68, CIFAR-10 Batch 47:  Loss:     0.1697 Validation Accuracy: 0.879400
Epoch 68, CIFAR-10 Batch 48:  Loss:     0.1415 Validation Accuracy: 0.879600
Epoch 68, CIFAR-10 Batch 49:  Loss:     0.2252 Validation Accuracy: 0.875000
Epoch 68, CIFAR-10 Batch 50:  Loss:     0.1385 Validation Accuracy: 0.885800
Epoch 69, CIFAR-10 Batch 1:  Loss:     0.1340 Validation Accuracy: 0.877600
Epoch 69, CIFAR-10 Batch 2:  Loss:     0.1396 Validation Accuracy: 0.871600
Epoch 69, CIFAR-10 Batch 3:  Loss:     0.1383 Validation Accuracy: 0.888800
Epoch 69, CIFAR-10 Batch 4:  Loss:     0.1475 Validation Accuracy: 0.880400
Epoch 69, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.891000
Epoch 69, CIFAR-10 Batch 6:  Loss:     0.2392 Validation Accuracy: 0.892000
Epoch 69, CIFAR-10 Batch 7:  Loss:     0.1404 Validation Accuracy: 0.884400
Epoch 69, CIFAR-10 Batch 8:  Loss:     0.1726 Validation Accuracy: 0.889600
Epoch 69, CIFAR-10 Batch 9:  Loss:     0.1405 Validation Accuracy: 0.886800
Epoch 69, CIFAR-10 Batch 10:  Loss:     0.1344 Validation Accuracy: 0.874200
Epoch 69, CIFAR-10 Batch 11:  Loss:     0.1355 Validation Accuracy: 0.882800
Epoch 69, CIFAR-10 Batch 12:  Loss:     0.1550 Validation Accuracy: 0.883000
Epoch 69, CIFAR-10 Batch 13:  Loss:     0.1467 Validation Accuracy: 0.881400
Epoch 69, CIFAR-10 Batch 14:  Loss:     0.1903 Validation Accuracy: 0.883800
Epoch 69, CIFAR-10 Batch 15:  Loss:     0.1905 Validation Accuracy: 0.882000
Epoch 69, CIFAR-10 Batch 16:  Loss:     0.1548 Validation Accuracy: 0.872200
Epoch 69, CIFAR-10 Batch 17:  Loss:     0.1982 Validation Accuracy: 0.873000
Epoch 69, CIFAR-10 Batch 18:  Loss:     0.1469 Validation Accuracy: 0.873400
Epoch 69, CIFAR-10 Batch 19:  Loss:     0.1431 Validation Accuracy: 0.862400
Epoch 69, CIFAR-10 Batch 20:  Loss:     0.1993 Validation Accuracy: 0.866800
Epoch 69, CIFAR-10 Batch 21:  Loss:     0.1407 Validation Accuracy: 0.875600
Epoch 69, CIFAR-10 Batch 22:  Loss:     0.1906 Validation Accuracy: 0.883600
Epoch 69, CIFAR-10 Batch 23:  Loss:     0.1669 Validation Accuracy: 0.885400
Epoch 69, CIFAR-10 Batch 24:  Loss:     0.1709 Validation Accuracy: 0.886800
Epoch 69, CIFAR-10 Batch 25:  Loss:     0.1970 Validation Accuracy: 0.880000
Epoch 69, CIFAR-10 Batch 26:  Loss:     0.1681 Validation Accuracy: 0.880400
Epoch 69, CIFAR-10 Batch 27:  Loss:     0.1257 Validation Accuracy: 0.884000
Epoch 69, CIFAR-10 Batch 28:  Loss:     0.2289 Validation Accuracy: 0.885400
Epoch 69, CIFAR-10 Batch 29:  Loss:     0.1461 Validation Accuracy: 0.871200
Epoch 69, CIFAR-10 Batch 30:  Loss:     0.1316 Validation Accuracy: 0.876400
Epoch 69, CIFAR-10 Batch 31:  Loss:     0.1471 Validation Accuracy: 0.870200
Epoch 69, CIFAR-10 Batch 32:  Loss:     0.1770 Validation Accuracy: 0.886000
Epoch 69, CIFAR-10 Batch 33:  Loss:     0.2093 Validation Accuracy: 0.881000
Epoch 69, CIFAR-10 Batch 34:  Loss:     0.2155 Validation Accuracy: 0.879600
Epoch 69, CIFAR-10 Batch 35:  Loss:     0.1778 Validation Accuracy: 0.882200
Epoch 69, CIFAR-10 Batch 36:  Loss:     0.2256 Validation Accuracy: 0.870800
Epoch 69, CIFAR-10 Batch 37:  Loss:     0.1480 Validation Accuracy: 0.878800
Epoch 69, CIFAR-10 Batch 38:  Loss:     0.1307 Validation Accuracy: 0.877800
Epoch 69, CIFAR-10 Batch 39:  Loss:     0.1396 Validation Accuracy: 0.877000
Epoch 69, CIFAR-10 Batch 40:  Loss:     0.1506 Validation Accuracy: 0.873400
Epoch 69, CIFAR-10 Batch 41:  Loss:     0.1727 Validation Accuracy: 0.873000
Epoch 69, CIFAR-10 Batch 42:  Loss:     0.1678 Validation Accuracy: 0.878000
Epoch 69, CIFAR-10 Batch 43:  Loss:     0.2204 Validation Accuracy: 0.872200
Epoch 69, CIFAR-10 Batch 44:  Loss:     0.1518 Validation Accuracy: 0.887000
Epoch 69, CIFAR-10 Batch 45:  Loss:     0.1432 Validation Accuracy: 0.871800
Epoch 69, CIFAR-10 Batch 46:  Loss:     0.1930 Validation Accuracy: 0.867200
Epoch 69, CIFAR-10 Batch 47:  Loss:     0.1662 Validation Accuracy: 0.880400
Epoch 69, CIFAR-10 Batch 48:  Loss:     0.1503 Validation Accuracy: 0.882400
Epoch 69, CIFAR-10 Batch 49:  Loss:     0.1877 Validation Accuracy: 0.872800
Epoch 69, CIFAR-10 Batch 50:  Loss:     0.1551 Validation Accuracy: 0.860000
Epoch 70, CIFAR-10 Batch 1:  Loss:     0.1481 Validation Accuracy: 0.884800
Epoch 70, CIFAR-10 Batch 2:  Loss:     0.1549 Validation Accuracy: 0.881000
Epoch 70, CIFAR-10 Batch 3:  Loss:     0.1442 Validation Accuracy: 0.870600
Epoch 70, CIFAR-10 Batch 4:  Loss:     0.1496 Validation Accuracy: 0.882400
Epoch 70, CIFAR-10 Batch 5:  Loss:     0.1539 Validation Accuracy: 0.876400
Epoch 70, CIFAR-10 Batch 6:  Loss:     0.2455 Validation Accuracy: 0.881600
Epoch 70, CIFAR-10 Batch 7:  Loss:     0.1514 Validation Accuracy: 0.870000
Epoch 70, CIFAR-10 Batch 8:  Loss:     0.2046 Validation Accuracy: 0.880200
Epoch 70, CIFAR-10 Batch 9:  Loss:     0.1794 Validation Accuracy: 0.883400
Epoch 70, CIFAR-10 Batch 10:  Loss:     0.1318 Validation Accuracy: 0.875400
Epoch 70, CIFAR-10 Batch 11:  Loss:     0.1529 Validation Accuracy: 0.882200
Epoch 70, CIFAR-10 Batch 12:  Loss:     0.1767 Validation Accuracy: 0.866400
Epoch 70, CIFAR-10 Batch 13:  Loss:     0.1633 Validation Accuracy: 0.872400
Epoch 70, CIFAR-10 Batch 14:  Loss:     0.1922 Validation Accuracy: 0.883000
Epoch 70, CIFAR-10 Batch 15:  Loss:     0.1504 Validation Accuracy: 0.885400
Epoch 70, CIFAR-10 Batch 16:  Loss:     0.1727 Validation Accuracy: 0.882800
Epoch 70, CIFAR-10 Batch 17:  Loss:     0.1578 Validation Accuracy: 0.883200
Epoch 70, CIFAR-10 Batch 18:  Loss:     0.1435 Validation Accuracy: 0.867400
Epoch 70, CIFAR-10 Batch 19:  Loss:     0.1575 Validation Accuracy: 0.879600
Epoch 70, CIFAR-10 Batch 20:  Loss:     0.2089 Validation Accuracy: 0.859600
Epoch 70, CIFAR-10 Batch 21:  Loss:     0.1399 Validation Accuracy: 0.877200
Epoch 70, CIFAR-10 Batch 22:  Loss:     0.1623 Validation Accuracy: 0.867400
Epoch 70, CIFAR-10 Batch 23:  Loss:     0.1556 Validation Accuracy: 0.883400
Epoch 70, CIFAR-10 Batch 24:  Loss:     0.1902 Validation Accuracy: 0.881200
Epoch 70, CIFAR-10 Batch 25:  Loss:     0.1940 Validation Accuracy: 0.872400
Epoch 70, CIFAR-10 Batch 26:  Loss:     0.1784 Validation Accuracy: 0.879200
Epoch 70, CIFAR-10 Batch 27:  Loss:     0.1309 Validation Accuracy: 0.871800
Epoch 70, CIFAR-10 Batch 28:  Loss:     0.2423 Validation Accuracy: 0.878600
Epoch 70, CIFAR-10 Batch 29:  Loss:     0.1778 Validation Accuracy: 0.880800
Epoch 70, CIFAR-10 Batch 30:  Loss:     0.1357 Validation Accuracy: 0.879000
Epoch 70, CIFAR-10 Batch 31:  Loss:     0.1448 Validation Accuracy: 0.885200
Epoch 70, CIFAR-10 Batch 32:  Loss:     0.1545 Validation Accuracy: 0.877600
Epoch 70, CIFAR-10 Batch 33:  Loss:     0.2431 Validation Accuracy: 0.874800
Epoch 70, CIFAR-10 Batch 34:  Loss:     0.2061 Validation Accuracy: 0.892000
Epoch 70, CIFAR-10 Batch 35:  Loss:     0.2391 Validation Accuracy: 0.886200
Epoch 70, CIFAR-10 Batch 36:  Loss:     0.2377 Validation Accuracy: 0.879400
Epoch 70, CIFAR-10 Batch 37:  Loss:     0.1314 Validation Accuracy: 0.876400
Epoch 70, CIFAR-10 Batch 38:  Loss:     0.1366 Validation Accuracy: 0.884200
Epoch 70, CIFAR-10 Batch 39:  Loss:     0.1309 Validation Accuracy: 0.883600
Epoch 70, CIFAR-10 Batch 40:  Loss:     0.1664 Validation Accuracy: 0.876000
Epoch 70, CIFAR-10 Batch 41:  Loss:     0.1591 Validation Accuracy: 0.891200
Epoch 70, CIFAR-10 Batch 42:  Loss:     0.1653 Validation Accuracy: 0.872400
Epoch 70, CIFAR-10 Batch 43:  Loss:     0.2067 Validation Accuracy: 0.885400
Epoch 70, CIFAR-10 Batch 44:  Loss:     0.1522 Validation Accuracy: 0.859200
Epoch 70, CIFAR-10 Batch 45:  Loss:     0.1393 Validation Accuracy: 0.880800
Epoch 70, CIFAR-10 Batch 46:  Loss:     0.1645 Validation Accuracy: 0.888600
Epoch 70, CIFAR-10 Batch 47:  Loss:     0.1649 Validation Accuracy: 0.878000
Epoch 70, CIFAR-10 Batch 48:  Loss:     0.1790 Validation Accuracy: 0.888000
Epoch 70, CIFAR-10 Batch 49:  Loss:     0.1908 Validation Accuracy: 0.884200
Epoch 70, CIFAR-10 Batch 50:  Loss:     0.1584 Validation Accuracy: 0.873400
Epoch 71, CIFAR-10 Batch 1:  Loss:     0.1590 Validation Accuracy: 0.883200
Epoch 71, CIFAR-10 Batch 2:  Loss:     0.1648 Validation Accuracy: 0.879800
Epoch 71, CIFAR-10 Batch 3:  Loss:     0.1397 Validation Accuracy: 0.885800
Epoch 71, CIFAR-10 Batch 4:  Loss:     0.1470 Validation Accuracy: 0.874000
Epoch 71, CIFAR-10 Batch 5:  Loss:     0.1696 Validation Accuracy: 0.890400
Epoch 71, CIFAR-10 Batch 6:  Loss:     0.1994 Validation Accuracy: 0.889400
Epoch 71, CIFAR-10 Batch 7:  Loss:     0.1589 Validation Accuracy: 0.879200
Epoch 71, CIFAR-10 Batch 8:  Loss:     0.1824 Validation Accuracy: 0.880600
Epoch 71, CIFAR-10 Batch 9:  Loss:     0.1501 Validation Accuracy: 0.880800
Epoch 71, CIFAR-10 Batch 10:  Loss:     0.1333 Validation Accuracy: 0.874800
Epoch 71, CIFAR-10 Batch 11:  Loss:     0.1410 Validation Accuracy: 0.887200
Epoch 71, CIFAR-10 Batch 12:  Loss:     0.1778 Validation Accuracy: 0.887800
Epoch 71, CIFAR-10 Batch 13:  Loss:     0.2108 Validation Accuracy: 0.882200
Epoch 71, CIFAR-10 Batch 14:  Loss:     0.1655 Validation Accuracy: 0.873800
Epoch 71, CIFAR-10 Batch 15:  Loss:     0.1446 Validation Accuracy: 0.878600
Epoch 71, CIFAR-10 Batch 16:  Loss:     0.1695 Validation Accuracy: 0.856000
Epoch 71, CIFAR-10 Batch 17:  Loss:     0.1766 Validation Accuracy: 0.872200
Epoch 71, CIFAR-10 Batch 18:  Loss:     0.1413 Validation Accuracy: 0.878800
Epoch 71, CIFAR-10 Batch 19:  Loss:     0.1469 Validation Accuracy: 0.886200
Epoch 71, CIFAR-10 Batch 20:  Loss:     0.2210 Validation Accuracy: 0.876200
Epoch 71, CIFAR-10 Batch 21:  Loss:     0.1340 Validation Accuracy: 0.879400
Epoch 71, CIFAR-10 Batch 22:  Loss:     0.1762 Validation Accuracy: 0.859200
Epoch 71, CIFAR-10 Batch 23:  Loss:     0.1391 Validation Accuracy: 0.878800
Epoch 71, CIFAR-10 Batch 24:  Loss:     0.1705 Validation Accuracy: 0.883600
Epoch 71, CIFAR-10 Batch 25:  Loss:     0.1696 Validation Accuracy: 0.869000
Epoch 71, CIFAR-10 Batch 26:  Loss:     0.1484 Validation Accuracy: 0.880400
Epoch 71, CIFAR-10 Batch 27:  Loss:     0.1261 Validation Accuracy: 0.879600
Epoch 71, CIFAR-10 Batch 28:  Loss:     0.2470 Validation Accuracy: 0.874000
Epoch 71, CIFAR-10 Batch 29:  Loss:     0.1658 Validation Accuracy: 0.878800
Epoch 71, CIFAR-10 Batch 30:  Loss:     0.1309 Validation Accuracy: 0.877000
Epoch 71, CIFAR-10 Batch 31:  Loss:     0.1363 Validation Accuracy: 0.877400
Epoch 71, CIFAR-10 Batch 32:  Loss:     0.1361 Validation Accuracy: 0.888200
Epoch 71, CIFAR-10 Batch 33:  Loss:     0.2449 Validation Accuracy: 0.850600
Epoch 71, CIFAR-10 Batch 34:  Loss:     0.2215 Validation Accuracy: 0.878400
Epoch 71, CIFAR-10 Batch 35:  Loss:     0.2056 Validation Accuracy: 0.885000
Epoch 71, CIFAR-10 Batch 36:  Loss:     0.2242 Validation Accuracy: 0.886400
Epoch 71, CIFAR-10 Batch 37:  Loss:     0.1735 Validation Accuracy: 0.881400
Epoch 71, CIFAR-10 Batch 38:  Loss:     0.1406 Validation Accuracy: 0.868400
Epoch 71, CIFAR-10 Batch 39:  Loss:     0.1413 Validation Accuracy: 0.869400
Epoch 71, CIFAR-10 Batch 40:  Loss:     0.1583 Validation Accuracy: 0.865000
Epoch 71, CIFAR-10 Batch 41:  Loss:     0.1702 Validation Accuracy: 0.883200
Epoch 71, CIFAR-10 Batch 42:  Loss:     0.1582 Validation Accuracy: 0.885400
Epoch 71, CIFAR-10 Batch 43:  Loss:     0.2461 Validation Accuracy: 0.877600
Epoch 71, CIFAR-10 Batch 44:  Loss:     0.1489 Validation Accuracy: 0.877200
Epoch 71, CIFAR-10 Batch 45:  Loss:     0.1494 Validation Accuracy: 0.872000
Epoch 71, CIFAR-10 Batch 46:  Loss:     0.1445 Validation Accuracy: 0.878000
Epoch 71, CIFAR-10 Batch 47:  Loss:     0.1582 Validation Accuracy: 0.885400
Epoch 71, CIFAR-10 Batch 48:  Loss:     0.1635 Validation Accuracy: 0.884000
Epoch 71, CIFAR-10 Batch 49:  Loss:     0.1761 Validation Accuracy: 0.876600
Epoch 71, CIFAR-10 Batch 50:  Loss:     0.1743 Validation Accuracy: 0.884200
Epoch 72, CIFAR-10 Batch 1:  Loss:     0.1813 Validation Accuracy: 0.891200
Epoch 72, CIFAR-10 Batch 2:  Loss:     0.1495 Validation Accuracy: 0.867000
Epoch 72, CIFAR-10 Batch 3:  Loss:     0.1407 Validation Accuracy: 0.886000
Epoch 72, CIFAR-10 Batch 4:  Loss:     0.1448 Validation Accuracy: 0.870800
Epoch 72, CIFAR-10 Batch 5:  Loss:     0.1622 Validation Accuracy: 0.884200
Epoch 72, CIFAR-10 Batch 6:  Loss:     0.2277 Validation Accuracy: 0.887800
Epoch 72, CIFAR-10 Batch 7:  Loss:     0.1358 Validation Accuracy: 0.880600
Epoch 72, CIFAR-10 Batch 8:  Loss:     0.2132 Validation Accuracy: 0.882600
Epoch 72, CIFAR-10 Batch 9:  Loss:     0.1619 Validation Accuracy: 0.889000
Epoch 72, CIFAR-10 Batch 10:  Loss:     0.1266 Validation Accuracy: 0.876400
Epoch 72, CIFAR-10 Batch 11:  Loss:     0.1381 Validation Accuracy: 0.890600
Epoch 72, CIFAR-10 Batch 12:  Loss:     0.1517 Validation Accuracy: 0.876400
Epoch 72, CIFAR-10 Batch 13:  Loss:     0.1549 Validation Accuracy: 0.882000
Epoch 72, CIFAR-10 Batch 14:  Loss:     0.1678 Validation Accuracy: 0.881000
Epoch 72, CIFAR-10 Batch 15:  Loss:     0.1921 Validation Accuracy: 0.865600
Epoch 72, CIFAR-10 Batch 16:  Loss:     0.1620 Validation Accuracy: 0.877000
Epoch 72, CIFAR-10 Batch 17:  Loss:     0.1840 Validation Accuracy: 0.883800
Epoch 72, CIFAR-10 Batch 18:  Loss:     0.1432 Validation Accuracy: 0.891600
Epoch 72, CIFAR-10 Batch 19:  Loss:     0.1399 Validation Accuracy: 0.882200
Epoch 72, CIFAR-10 Batch 20:  Loss:     0.1916 Validation Accuracy: 0.875400
Epoch 72, CIFAR-10 Batch 21:  Loss:     0.1459 Validation Accuracy: 0.872200
Epoch 72, CIFAR-10 Batch 22:  Loss:     0.1594 Validation Accuracy: 0.866000
Epoch 72, CIFAR-10 Batch 23:  Loss:     0.1604 Validation Accuracy: 0.881600
Epoch 72, CIFAR-10 Batch 24:  Loss:     0.1630 Validation Accuracy: 0.886600
Epoch 72, CIFAR-10 Batch 25:  Loss:     0.1734 Validation Accuracy: 0.872800
Epoch 72, CIFAR-10 Batch 26:  Loss:     0.1637 Validation Accuracy: 0.886800
Epoch 72, CIFAR-10 Batch 27:  Loss:     0.1304 Validation Accuracy: 0.879600
Epoch 72, CIFAR-10 Batch 28:  Loss:     0.1982 Validation Accuracy: 0.882600
Epoch 72, CIFAR-10 Batch 29:  Loss:     0.1946 Validation Accuracy: 0.871400
Epoch 72, CIFAR-10 Batch 30:  Loss:     0.1483 Validation Accuracy: 0.874600
Epoch 72, CIFAR-10 Batch 31:  Loss:     0.1429 Validation Accuracy: 0.871000
Epoch 72, CIFAR-10 Batch 32:  Loss:     0.1355 Validation Accuracy: 0.863400
Epoch 72, CIFAR-10 Batch 33:  Loss:     0.2081 Validation Accuracy: 0.877600
Epoch 72, CIFAR-10 Batch 34:  Loss:     0.2510 Validation Accuracy: 0.870000
Epoch 72, CIFAR-10 Batch 35:  Loss:     0.2020 Validation Accuracy: 0.884800
Epoch 72, CIFAR-10 Batch 36:  Loss:     0.2234 Validation Accuracy: 0.872800
Epoch 72, CIFAR-10 Batch 37:  Loss:     0.1668 Validation Accuracy: 0.880200
Epoch 72, CIFAR-10 Batch 38:  Loss:     0.1513 Validation Accuracy: 0.883800
Epoch 72, CIFAR-10 Batch 39:  Loss:     0.1678 Validation Accuracy: 0.891000
Epoch 72, CIFAR-10 Batch 40:  Loss:     0.1653 Validation Accuracy: 0.877800
Epoch 72, CIFAR-10 Batch 41:  Loss:     0.1640 Validation Accuracy: 0.888600
Epoch 72, CIFAR-10 Batch 42:  Loss:     0.1679 Validation Accuracy: 0.879200
Epoch 72, CIFAR-10 Batch 43:  Loss:     0.2123 Validation Accuracy: 0.884200
Epoch 72, CIFAR-10 Batch 44:  Loss:     0.1424 Validation Accuracy: 0.870600
Epoch 72, CIFAR-10 Batch 45:  Loss:     0.1635 Validation Accuracy: 0.874000
Epoch 72, CIFAR-10 Batch 46:  Loss:     0.1520 Validation Accuracy: 0.875800
Epoch 72, CIFAR-10 Batch 47:  Loss:     0.1604 Validation Accuracy: 0.883600
Epoch 72, CIFAR-10 Batch 48:  Loss:     0.1609 Validation Accuracy: 0.880600
Epoch 72, CIFAR-10 Batch 49:  Loss:     0.1759 Validation Accuracy: 0.882800
Epoch 72, CIFAR-10 Batch 50:  Loss:     0.1679 Validation Accuracy: 0.877600
Epoch 73, CIFAR-10 Batch 1:  Loss:     0.1586 Validation Accuracy: 0.882000
Epoch 73, CIFAR-10 Batch 2:  Loss:     0.1392 Validation Accuracy: 0.877800
Epoch 73, CIFAR-10 Batch 3:  Loss:     0.1299 Validation Accuracy: 0.890800
Epoch 73, CIFAR-10 Batch 4:  Loss:     0.1476 Validation Accuracy: 0.872800
Epoch 73, CIFAR-10 Batch 5:  Loss:     0.1476 Validation Accuracy: 0.887000
Epoch 73, CIFAR-10 Batch 6:  Loss:     0.2625 Validation Accuracy: 0.882200
Epoch 73, CIFAR-10 Batch 7:  Loss:     0.1734 Validation Accuracy: 0.875400
Epoch 73, CIFAR-10 Batch 8:  Loss:     0.1805 Validation Accuracy: 0.878200
Epoch 73, CIFAR-10 Batch 9:  Loss:     0.1502 Validation Accuracy: 0.886200
Epoch 73, CIFAR-10 Batch 10:  Loss:     0.1323 Validation Accuracy: 0.885400
Epoch 73, CIFAR-10 Batch 11:  Loss:     0.1508 Validation Accuracy: 0.879400
Epoch 73, CIFAR-10 Batch 12:  Loss:     0.1710 Validation Accuracy: 0.889200
Epoch 73, CIFAR-10 Batch 13:  Loss:     0.1987 Validation Accuracy: 0.883600
Epoch 73, CIFAR-10 Batch 14:  Loss:     0.1489 Validation Accuracy: 0.876200
Epoch 73, CIFAR-10 Batch 15:  Loss:     0.1493 Validation Accuracy: 0.887200
Epoch 73, CIFAR-10 Batch 16:  Loss:     0.1546 Validation Accuracy: 0.871600
Epoch 73, CIFAR-10 Batch 17:  Loss:     0.2335 Validation Accuracy: 0.880600
Epoch 73, CIFAR-10 Batch 18:  Loss:     0.1466 Validation Accuracy: 0.870000
Epoch 73, CIFAR-10 Batch 19:  Loss:     0.1378 Validation Accuracy: 0.886000
Epoch 73, CIFAR-10 Batch 20:  Loss:     0.2229 Validation Accuracy: 0.881800
Epoch 73, CIFAR-10 Batch 21:  Loss:     0.1342 Validation Accuracy: 0.886400
Epoch 73, CIFAR-10 Batch 22:  Loss:     0.1645 Validation Accuracy: 0.885400
Epoch 73, CIFAR-10 Batch 23:  Loss:     0.1465 Validation Accuracy: 0.880400
Epoch 73, CIFAR-10 Batch 24:  Loss:     0.1597 Validation Accuracy: 0.880200
Epoch 73, CIFAR-10 Batch 25:  Loss:     0.1718 Validation Accuracy: 0.865400
Epoch 73, CIFAR-10 Batch 26:  Loss:     0.1517 Validation Accuracy: 0.883000
Epoch 73, CIFAR-10 Batch 27:  Loss:     0.1332 Validation Accuracy: 0.875600
Epoch 73, CIFAR-10 Batch 28:  Loss:     0.1757 Validation Accuracy: 0.885400
Epoch 73, CIFAR-10 Batch 29:  Loss:     0.1585 Validation Accuracy: 0.880800
Epoch 73, CIFAR-10 Batch 30:  Loss:     0.1404 Validation Accuracy: 0.872200
Epoch 73, CIFAR-10 Batch 31:  Loss:     0.1480 Validation Accuracy: 0.866400
Epoch 73, CIFAR-10 Batch 32:  Loss:     0.1349 Validation Accuracy: 0.875600
Epoch 73, CIFAR-10 Batch 33:  Loss:     0.2078 Validation Accuracy: 0.869400
Epoch 73, CIFAR-10 Batch 34:  Loss:     0.3079 Validation Accuracy: 0.878800
Epoch 73, CIFAR-10 Batch 35:  Loss:     0.2002 Validation Accuracy: 0.890400
Epoch 73, CIFAR-10 Batch 36:  Loss:     0.2441 Validation Accuracy: 0.885200
Epoch 73, CIFAR-10 Batch 37:  Loss:     0.1725 Validation Accuracy: 0.871000
Epoch 73, CIFAR-10 Batch 38:  Loss:     0.1381 Validation Accuracy: 0.875000
Epoch 73, CIFAR-10 Batch 39:  Loss:     0.1361 Validation Accuracy: 0.871800
Epoch 73, CIFAR-10 Batch 40:  Loss:     0.1455 Validation Accuracy: 0.856400
Epoch 73, CIFAR-10 Batch 41:  Loss:     0.1489 Validation Accuracy: 0.877000
Epoch 73, CIFAR-10 Batch 42:  Loss:     0.1607 Validation Accuracy: 0.868200
Epoch 73, CIFAR-10 Batch 43:  Loss:     0.2405 Validation Accuracy: 0.887200
Epoch 73, CIFAR-10 Batch 44:  Loss:     0.1533 Validation Accuracy: 0.874200
Epoch 73, CIFAR-10 Batch 45:  Loss:     0.1406 Validation Accuracy: 0.881400
Epoch 73, CIFAR-10 Batch 46:  Loss:     0.1484 Validation Accuracy: 0.856800
Epoch 73, CIFAR-10 Batch 47:  Loss:     0.1836 Validation Accuracy: 0.882600
Epoch 73, CIFAR-10 Batch 48:  Loss:     0.1792 Validation Accuracy: 0.882000
Epoch 73, CIFAR-10 Batch 49:  Loss:     0.2414 Validation Accuracy: 0.886000
Epoch 73, CIFAR-10 Batch 50:  Loss:     0.1536 Validation Accuracy: 0.873000
Epoch 74, CIFAR-10 Batch 1:  Loss:     0.1481 Validation Accuracy: 0.864400
Epoch 74, CIFAR-10 Batch 2:  Loss:     0.1406 Validation Accuracy: 0.884600
Epoch 74, CIFAR-10 Batch 3:  Loss:     0.1317 Validation Accuracy: 0.876200
Epoch 74, CIFAR-10 Batch 4:  Loss:     0.1501 Validation Accuracy: 0.877200
Epoch 74, CIFAR-10 Batch 5:  Loss:     0.1588 Validation Accuracy: 0.883200
Epoch 74, CIFAR-10 Batch 6:  Loss:     0.2463 Validation Accuracy: 0.877200
Epoch 74, CIFAR-10 Batch 7:  Loss:     0.1366 Validation Accuracy: 0.885000
Epoch 74, CIFAR-10 Batch 8:  Loss:     0.1972 Validation Accuracy: 0.880400
Epoch 74, CIFAR-10 Batch 9:  Loss:     0.1472 Validation Accuracy: 0.882600
Epoch 74, CIFAR-10 Batch 10:  Loss:     0.1421 Validation Accuracy: 0.882800
Epoch 74, CIFAR-10 Batch 11:  Loss:     0.1574 Validation Accuracy: 0.883000
Epoch 74, CIFAR-10 Batch 12:  Loss:     0.1499 Validation Accuracy: 0.882400
Epoch 74, CIFAR-10 Batch 13:  Loss:     0.1763 Validation Accuracy: 0.878400
Epoch 74, CIFAR-10 Batch 14:  Loss:     0.1785 Validation Accuracy: 0.885400
Epoch 74, CIFAR-10 Batch 15:  Loss:     0.1595 Validation Accuracy: 0.879800
Epoch 74, CIFAR-10 Batch 16:  Loss:     0.1586 Validation Accuracy: 0.870800
Epoch 74, CIFAR-10 Batch 17:  Loss:     0.1948 Validation Accuracy: 0.877000
Epoch 74, CIFAR-10 Batch 18:  Loss:     0.1536 Validation Accuracy: 0.866200
Epoch 74, CIFAR-10 Batch 19:  Loss:     0.1402 Validation Accuracy: 0.876000
Epoch 74, CIFAR-10 Batch 20:  Loss:     0.2124 Validation Accuracy: 0.881600
Epoch 74, CIFAR-10 Batch 21:  Loss:     0.1293 Validation Accuracy: 0.881400
Epoch 74, CIFAR-10 Batch 22:  Loss:     0.2131 Validation Accuracy: 0.883000
Epoch 74, CIFAR-10 Batch 23:  Loss:     0.1614 Validation Accuracy: 0.881600
Epoch 74, CIFAR-10 Batch 24:  Loss:     0.1724 Validation Accuracy: 0.886800
Epoch 74, CIFAR-10 Batch 25:  Loss:     0.2181 Validation Accuracy: 0.880200
Epoch 74, CIFAR-10 Batch 26:  Loss:     0.1618 Validation Accuracy: 0.883600
Epoch 74, CIFAR-10 Batch 27:  Loss:     0.1305 Validation Accuracy: 0.877800
Epoch 74, CIFAR-10 Batch 28:  Loss:     0.1679 Validation Accuracy: 0.877200
Epoch 74, CIFAR-10 Batch 29:  Loss:     0.1401 Validation Accuracy: 0.881800
Epoch 74, CIFAR-10 Batch 30:  Loss:     0.1277 Validation Accuracy: 0.874600
Epoch 74, CIFAR-10 Batch 31:  Loss:     0.1318 Validation Accuracy: 0.873600
Epoch 74, CIFAR-10 Batch 32:  Loss:     0.1456 Validation Accuracy: 0.872600
Epoch 74, CIFAR-10 Batch 33:  Loss:     0.2346 Validation Accuracy: 0.874800
Epoch 74, CIFAR-10 Batch 34:  Loss:     0.2692 Validation Accuracy: 0.881200
Epoch 74, CIFAR-10 Batch 35:  Loss:     0.2318 Validation Accuracy: 0.876400
Epoch 74, CIFAR-10 Batch 36:  Loss:     0.2068 Validation Accuracy: 0.874800
Epoch 74, CIFAR-10 Batch 37:  Loss:     0.1719 Validation Accuracy: 0.881800
Epoch 74, CIFAR-10 Batch 38:  Loss:     0.1307 Validation Accuracy: 0.876200
Epoch 74, CIFAR-10 Batch 39:  Loss:     0.1374 Validation Accuracy: 0.873400
Epoch 74, CIFAR-10 Batch 40:  Loss:     0.1509 Validation Accuracy: 0.876000
Epoch 74, CIFAR-10 Batch 41:  Loss:     0.1515 Validation Accuracy: 0.879800
Epoch 74, CIFAR-10 Batch 42:  Loss:     0.1565 Validation Accuracy: 0.876400
Epoch 74, CIFAR-10 Batch 43:  Loss:     0.2393 Validation Accuracy: 0.870800
Epoch 74, CIFAR-10 Batch 44:  Loss:     0.1490 Validation Accuracy: 0.877000
Epoch 74, CIFAR-10 Batch 45:  Loss:     0.1497 Validation Accuracy: 0.871800
Epoch 74, CIFAR-10 Batch 46:  Loss:     0.1618 Validation Accuracy: 0.874200
Epoch 74, CIFAR-10 Batch 47:  Loss:     0.1581 Validation Accuracy: 0.885400
Epoch 74, CIFAR-10 Batch 48:  Loss:     0.1531 Validation Accuracy: 0.872800
Epoch 74, CIFAR-10 Batch 49:  Loss:     0.2211 Validation Accuracy: 0.884800
Epoch 74, CIFAR-10 Batch 50:  Loss:     0.1480 Validation Accuracy: 0.881200
Epoch 75, CIFAR-10 Batch 1:  Loss:     0.1620 Validation Accuracy: 0.881000
Epoch 75, CIFAR-10 Batch 2:  Loss:     0.1439 Validation Accuracy: 0.876400
Epoch 75, CIFAR-10 Batch 3:  Loss:     0.1555 Validation Accuracy: 0.889200
Epoch 75, CIFAR-10 Batch 4:  Loss:     0.1657 Validation Accuracy: 0.875600
Epoch 75, CIFAR-10 Batch 5:  Loss:     0.1444 Validation Accuracy: 0.871000
Epoch 75, CIFAR-10 Batch 6:  Loss:     0.2553 Validation Accuracy: 0.877800
Epoch 75, CIFAR-10 Batch 7:  Loss:     0.1332 Validation Accuracy: 0.881200
Epoch 75, CIFAR-10 Batch 8:  Loss:     0.1814 Validation Accuracy: 0.877800
Epoch 75, CIFAR-10 Batch 9:  Loss:     0.1562 Validation Accuracy: 0.880800
Epoch 75, CIFAR-10 Batch 10:  Loss:     0.1291 Validation Accuracy: 0.885200
Epoch 75, CIFAR-10 Batch 11:  Loss:     0.1596 Validation Accuracy: 0.876400
Epoch 75, CIFAR-10 Batch 12:  Loss:     0.1492 Validation Accuracy: 0.865800
Epoch 75, CIFAR-10 Batch 13:  Loss:     0.1610 Validation Accuracy: 0.868400
Epoch 75, CIFAR-10 Batch 14:  Loss:     0.1682 Validation Accuracy: 0.865000
Epoch 75, CIFAR-10 Batch 15:  Loss:     0.1740 Validation Accuracy: 0.881800
Epoch 75, CIFAR-10 Batch 16:  Loss:     0.1845 Validation Accuracy: 0.883400
Epoch 75, CIFAR-10 Batch 17:  Loss:     0.1735 Validation Accuracy: 0.877000
Epoch 75, CIFAR-10 Batch 18:  Loss:     0.1455 Validation Accuracy: 0.867200
Epoch 75, CIFAR-10 Batch 19:  Loss:     0.1389 Validation Accuracy: 0.863000
Epoch 75, CIFAR-10 Batch 20:  Loss:     0.1937 Validation Accuracy: 0.879000
Epoch 75, CIFAR-10 Batch 21:  Loss:     0.1300 Validation Accuracy: 0.888600
Epoch 75, CIFAR-10 Batch 22:  Loss:     0.1912 Validation Accuracy: 0.860800
Epoch 75, CIFAR-10 Batch 23:  Loss:     0.1404 Validation Accuracy: 0.887800
Epoch 75, CIFAR-10 Batch 24:  Loss:     0.1623 Validation Accuracy: 0.883000
Epoch 75, CIFAR-10 Batch 25:  Loss:     0.1837 Validation Accuracy: 0.886200
Epoch 75, CIFAR-10 Batch 26:  Loss:     0.1689 Validation Accuracy: 0.878800
Epoch 75, CIFAR-10 Batch 27:  Loss:     0.1254 Validation Accuracy: 0.878000
Epoch 75, CIFAR-10 Batch 28:  Loss:     0.2024 Validation Accuracy: 0.876800
Epoch 75, CIFAR-10 Batch 29:  Loss:     0.1561 Validation Accuracy: 0.870400
Epoch 75, CIFAR-10 Batch 30:  Loss:     0.1321 Validation Accuracy: 0.882000
Epoch 75, CIFAR-10 Batch 31:  Loss:     0.1344 Validation Accuracy: 0.876200
Epoch 75, CIFAR-10 Batch 32:  Loss:     0.1394 Validation Accuracy: 0.871400
Epoch 75, CIFAR-10 Batch 33:  Loss:     0.1989 Validation Accuracy: 0.885000
Epoch 75, CIFAR-10 Batch 34:  Loss:     0.2364 Validation Accuracy: 0.875400
Epoch 75, CIFAR-10 Batch 35:  Loss:     0.1835 Validation Accuracy: 0.885600
Epoch 75, CIFAR-10 Batch 36:  Loss:     0.2552 Validation Accuracy: 0.881200
Epoch 75, CIFAR-10 Batch 37:  Loss:     0.1422 Validation Accuracy: 0.878000
Epoch 75, CIFAR-10 Batch 38:  Loss:     0.1305 Validation Accuracy: 0.873000
Epoch 75, CIFAR-10 Batch 39:  Loss:     0.1369 Validation Accuracy: 0.869000
Epoch 75, CIFAR-10 Batch 40:  Loss:     0.1555 Validation Accuracy: 0.878400
Epoch 75, CIFAR-10 Batch 41:  Loss:     0.1689 Validation Accuracy: 0.874400
Epoch 75, CIFAR-10 Batch 42:  Loss:     0.1690 Validation Accuracy: 0.881200
Epoch 75, CIFAR-10 Batch 43:  Loss:     0.1958 Validation Accuracy: 0.880600
Epoch 75, CIFAR-10 Batch 44:  Loss:     0.1433 Validation Accuracy: 0.885200
Epoch 75, CIFAR-10 Batch 45:  Loss:     0.1591 Validation Accuracy: 0.886600
Epoch 75, CIFAR-10 Batch 46:  Loss:     0.1551 Validation Accuracy: 0.879600
Epoch 75, CIFAR-10 Batch 47:  Loss:     0.1610 Validation Accuracy: 0.878600
Epoch 75, CIFAR-10 Batch 48:  Loss:     0.1517 Validation Accuracy: 0.881600
Epoch 75, CIFAR-10 Batch 49:  Loss:     0.2195 Validation Accuracy: 0.873800
Epoch 75, CIFAR-10 Batch 50:  Loss:     0.1614 Validation Accuracy: 0.880600
Epoch 76, CIFAR-10 Batch 1:  Loss:     0.1408 Validation Accuracy: 0.875000
Epoch 76, CIFAR-10 Batch 2:  Loss:     0.1409 Validation Accuracy: 0.880400
Epoch 76, CIFAR-10 Batch 3:  Loss:     0.1358 Validation Accuracy: 0.875200
Epoch 76, CIFAR-10 Batch 4:  Loss:     0.1481 Validation Accuracy: 0.883800
Epoch 76, CIFAR-10 Batch 5:  Loss:     0.1944 Validation Accuracy: 0.885200
Epoch 76, CIFAR-10 Batch 6:  Loss:     0.2480 Validation Accuracy: 0.892800
Epoch 76, CIFAR-10 Batch 7:  Loss:     0.1930 Validation Accuracy: 0.882400
Epoch 76, CIFAR-10 Batch 8:  Loss:     0.1796 Validation Accuracy: 0.873000
Epoch 76, CIFAR-10 Batch 9:  Loss:     0.1461 Validation Accuracy: 0.873200
Epoch 76, CIFAR-10 Batch 10:  Loss:     0.1284 Validation Accuracy: 0.882400
Epoch 76, CIFAR-10 Batch 11:  Loss:     0.1604 Validation Accuracy: 0.880200
Epoch 76, CIFAR-10 Batch 12:  Loss:     0.1422 Validation Accuracy: 0.880600
Epoch 76, CIFAR-10 Batch 13:  Loss:     0.1675 Validation Accuracy: 0.882600
Epoch 76, CIFAR-10 Batch 14:  Loss:     0.1554 Validation Accuracy: 0.873600
Epoch 76, CIFAR-10 Batch 15:  Loss:     0.1542 Validation Accuracy: 0.885000
Epoch 76, CIFAR-10 Batch 16:  Loss:     0.1898 Validation Accuracy: 0.876200
Epoch 76, CIFAR-10 Batch 17:  Loss:     0.1811 Validation Accuracy: 0.872600
Epoch 76, CIFAR-10 Batch 18:  Loss:     0.1477 Validation Accuracy: 0.865200
Epoch 76, CIFAR-10 Batch 19:  Loss:     0.1491 Validation Accuracy: 0.870800
Epoch 76, CIFAR-10 Batch 20:  Loss:     0.1771 Validation Accuracy: 0.883000
Epoch 76, CIFAR-10 Batch 21:  Loss:     0.1326 Validation Accuracy: 0.876000
Epoch 76, CIFAR-10 Batch 22:  Loss:     0.1661 Validation Accuracy: 0.891200
Epoch 76, CIFAR-10 Batch 23:  Loss:     0.1757 Validation Accuracy: 0.878000
Epoch 76, CIFAR-10 Batch 24:  Loss:     0.1704 Validation Accuracy: 0.886000
Epoch 76, CIFAR-10 Batch 25:  Loss:     0.1709 Validation Accuracy: 0.874400
Epoch 76, CIFAR-10 Batch 26:  Loss:     0.1547 Validation Accuracy: 0.883800
Epoch 76, CIFAR-10 Batch 27:  Loss:     0.1349 Validation Accuracy: 0.875200
Epoch 76, CIFAR-10 Batch 28:  Loss:     0.1791 Validation Accuracy: 0.880800
Epoch 76, CIFAR-10 Batch 29:  Loss:     0.1380 Validation Accuracy: 0.887600
Epoch 76, CIFAR-10 Batch 30:  Loss:     0.1343 Validation Accuracy: 0.874000
Epoch 76, CIFAR-10 Batch 31:  Loss:     0.1438 Validation Accuracy: 0.885800
Epoch 76, CIFAR-10 Batch 32:  Loss:     0.1473 Validation Accuracy: 0.880400
Epoch 76, CIFAR-10 Batch 33:  Loss:     0.2191 Validation Accuracy: 0.878600
Epoch 76, CIFAR-10 Batch 34:  Loss:     0.2140 Validation Accuracy: 0.878200
Epoch 76, CIFAR-10 Batch 35:  Loss:     0.1945 Validation Accuracy: 0.877400
Epoch 76, CIFAR-10 Batch 36:  Loss:     0.2141 Validation Accuracy: 0.881400
Epoch 76, CIFAR-10 Batch 37:  Loss:     0.1478 Validation Accuracy: 0.879200
Epoch 76, CIFAR-10 Batch 38:  Loss:     0.1353 Validation Accuracy: 0.878000
Epoch 76, CIFAR-10 Batch 39:  Loss:     0.1346 Validation Accuracy: 0.874600
Epoch 76, CIFAR-10 Batch 40:  Loss:     0.1379 Validation Accuracy: 0.885000
Epoch 76, CIFAR-10 Batch 41:  Loss:     0.1485 Validation Accuracy: 0.889000
Epoch 76, CIFAR-10 Batch 42:  Loss:     0.1684 Validation Accuracy: 0.879000
Epoch 76, CIFAR-10 Batch 43:  Loss:     0.2383 Validation Accuracy: 0.880600
Epoch 76, CIFAR-10 Batch 44:  Loss:     0.1519 Validation Accuracy: 0.876000
Epoch 76, CIFAR-10 Batch 45:  Loss:     0.1409 Validation Accuracy: 0.885200
Epoch 76, CIFAR-10 Batch 46:  Loss:     0.1552 Validation Accuracy: 0.884200
Epoch 76, CIFAR-10 Batch 47:  Loss:     0.1505 Validation Accuracy: 0.884800
Epoch 76, CIFAR-10 Batch 48:  Loss:     0.1636 Validation Accuracy: 0.877800
Epoch 76, CIFAR-10 Batch 49:  Loss:     0.2021 Validation Accuracy: 0.870000
Epoch 76, CIFAR-10 Batch 50:  Loss:     0.1563 Validation Accuracy: 0.886800
Epoch 77, CIFAR-10 Batch 1:  Loss:     0.1565 Validation Accuracy: 0.876200
Epoch 77, CIFAR-10 Batch 2:  Loss:     0.1490 Validation Accuracy: 0.886600
Epoch 77, CIFAR-10 Batch 3:  Loss:     0.1420 Validation Accuracy: 0.888000
Epoch 77, CIFAR-10 Batch 4:  Loss:     0.1676 Validation Accuracy: 0.884600
Epoch 77, CIFAR-10 Batch 5:  Loss:     0.1844 Validation Accuracy: 0.886200
Epoch 77, CIFAR-10 Batch 6:  Loss:     0.2322 Validation Accuracy: 0.883000
Epoch 77, CIFAR-10 Batch 7:  Loss:     0.1550 Validation Accuracy: 0.877600
Epoch 77, CIFAR-10 Batch 8:  Loss:     0.2045 Validation Accuracy: 0.859400
Epoch 77, CIFAR-10 Batch 9:  Loss:     0.1759 Validation Accuracy: 0.864800
Epoch 77, CIFAR-10 Batch 10:  Loss:     0.1464 Validation Accuracy: 0.883000
Epoch 77, CIFAR-10 Batch 11:  Loss:     0.1488 Validation Accuracy: 0.874800
Epoch 77, CIFAR-10 Batch 12:  Loss:     0.1469 Validation Accuracy: 0.882600
Epoch 77, CIFAR-10 Batch 13:  Loss:     0.1757 Validation Accuracy: 0.884000
Epoch 77, CIFAR-10 Batch 14:  Loss:     0.1603 Validation Accuracy: 0.872000
Epoch 77, CIFAR-10 Batch 15:  Loss:     0.1513 Validation Accuracy: 0.867200
Epoch 77, CIFAR-10 Batch 16:  Loss:     0.1729 Validation Accuracy: 0.885400
Epoch 77, CIFAR-10 Batch 17:  Loss:     0.1641 Validation Accuracy: 0.878600
Epoch 77, CIFAR-10 Batch 18:  Loss:     0.1518 Validation Accuracy: 0.862200
Epoch 77, CIFAR-10 Batch 19:  Loss:     0.1317 Validation Accuracy: 0.859400
Epoch 77, CIFAR-10 Batch 20:  Loss:     0.1675 Validation Accuracy: 0.875600
Epoch 77, CIFAR-10 Batch 21:  Loss:     0.1498 Validation Accuracy: 0.872000
Epoch 77, CIFAR-10 Batch 22:  Loss:     0.1959 Validation Accuracy: 0.873400
Epoch 77, CIFAR-10 Batch 23:  Loss:     0.1549 Validation Accuracy: 0.881000
Epoch 77, CIFAR-10 Batch 24:  Loss:     0.1576 Validation Accuracy: 0.875200
Epoch 77, CIFAR-10 Batch 25:  Loss:     0.2004 Validation Accuracy: 0.870600
Epoch 77, CIFAR-10 Batch 26:  Loss:     0.1496 Validation Accuracy: 0.881800
Epoch 77, CIFAR-10 Batch 27:  Loss:     0.1272 Validation Accuracy: 0.879200
Epoch 77, CIFAR-10 Batch 28:  Loss:     0.1977 Validation Accuracy: 0.883800
Epoch 77, CIFAR-10 Batch 29:  Loss:     0.1483 Validation Accuracy: 0.869400
Epoch 77, CIFAR-10 Batch 30:  Loss:     0.1306 Validation Accuracy: 0.878200
Epoch 77, CIFAR-10 Batch 31:  Loss:     0.1361 Validation Accuracy: 0.873200
Epoch 77, CIFAR-10 Batch 32:  Loss:     0.1544 Validation Accuracy: 0.880600
Epoch 77, CIFAR-10 Batch 33:  Loss:     0.2123 Validation Accuracy: 0.859400
Epoch 77, CIFAR-10 Batch 34:  Loss:     0.2212 Validation Accuracy: 0.871600
Epoch 77, CIFAR-10 Batch 35:  Loss:     0.1873 Validation Accuracy: 0.886600
Epoch 77, CIFAR-10 Batch 36:  Loss:     0.1924 Validation Accuracy: 0.870800
Epoch 77, CIFAR-10 Batch 37:  Loss:     0.1517 Validation Accuracy: 0.876400
Epoch 77, CIFAR-10 Batch 38:  Loss:     0.1292 Validation Accuracy: 0.890200
Epoch 77, CIFAR-10 Batch 39:  Loss:     0.1351 Validation Accuracy: 0.882400
Epoch 77, CIFAR-10 Batch 40:  Loss:     0.1591 Validation Accuracy: 0.870200
Epoch 77, CIFAR-10 Batch 41:  Loss:     0.1457 Validation Accuracy: 0.877400
Epoch 77, CIFAR-10 Batch 42:  Loss:     0.1924 Validation Accuracy: 0.869600
Epoch 77, CIFAR-10 Batch 43:  Loss:     0.2528 Validation Accuracy: 0.864000
Epoch 77, CIFAR-10 Batch 44:  Loss:     0.1595 Validation Accuracy: 0.875200
Epoch 77, CIFAR-10 Batch 45:  Loss:     0.1313 Validation Accuracy: 0.878600
Epoch 77, CIFAR-10 Batch 46:  Loss:     0.1830 Validation Accuracy: 0.859600
Epoch 77, CIFAR-10 Batch 47:  Loss:     0.1583 Validation Accuracy: 0.877200
Epoch 77, CIFAR-10 Batch 48:  Loss:     0.1783 Validation Accuracy: 0.881600
Epoch 77, CIFAR-10 Batch 49:  Loss:     0.1949 Validation Accuracy: 0.884200
Epoch 77, CIFAR-10 Batch 50:  Loss:     0.1549 Validation Accuracy: 0.877000
Epoch 78, CIFAR-10 Batch 1:  Loss:     0.1517 Validation Accuracy: 0.876400
Epoch 78, CIFAR-10 Batch 2:  Loss:     0.1832 Validation Accuracy: 0.880000
Epoch 78, CIFAR-10 Batch 3:  Loss:     0.1366 Validation Accuracy: 0.889800
Epoch 78, CIFAR-10 Batch 4:  Loss:     0.1369 Validation Accuracy: 0.876800
Epoch 78, CIFAR-10 Batch 5:  Loss:     0.1548 Validation Accuracy: 0.886800
Epoch 78, CIFAR-10 Batch 6:  Loss:     0.2673 Validation Accuracy: 0.888800
Epoch 78, CIFAR-10 Batch 7:  Loss:     0.1395 Validation Accuracy: 0.870400
Epoch 78, CIFAR-10 Batch 8:  Loss:     0.2135 Validation Accuracy: 0.880800
Epoch 78, CIFAR-10 Batch 9:  Loss:     0.1441 Validation Accuracy: 0.879800
Epoch 78, CIFAR-10 Batch 10:  Loss:     0.1576 Validation Accuracy: 0.886400
Epoch 78, CIFAR-10 Batch 11:  Loss:     0.1384 Validation Accuracy: 0.885600
Epoch 78, CIFAR-10 Batch 12:  Loss:     0.1641 Validation Accuracy: 0.881400
Epoch 78, CIFAR-10 Batch 13:  Loss:     0.1763 Validation Accuracy: 0.868400
Epoch 78, CIFAR-10 Batch 14:  Loss:     0.1679 Validation Accuracy: 0.886400
Epoch 78, CIFAR-10 Batch 15:  Loss:     0.1525 Validation Accuracy: 0.873600
Epoch 78, CIFAR-10 Batch 16:  Loss:     0.1656 Validation Accuracy: 0.874000
Epoch 78, CIFAR-10 Batch 17:  Loss:     0.1577 Validation Accuracy: 0.870000
Epoch 78, CIFAR-10 Batch 18:  Loss:     0.1549 Validation Accuracy: 0.866600
Epoch 78, CIFAR-10 Batch 19:  Loss:     0.1311 Validation Accuracy: 0.877600
Epoch 78, CIFAR-10 Batch 20:  Loss:     0.2262 Validation Accuracy: 0.876400
Epoch 78, CIFAR-10 Batch 21:  Loss:     0.1366 Validation Accuracy: 0.879000
Epoch 78, CIFAR-10 Batch 22:  Loss:     0.1563 Validation Accuracy: 0.881200
Epoch 78, CIFAR-10 Batch 23:  Loss:     0.1561 Validation Accuracy: 0.881400
Epoch 78, CIFAR-10 Batch 24:  Loss:     0.1944 Validation Accuracy: 0.886200
Epoch 78, CIFAR-10 Batch 25:  Loss:     0.2210 Validation Accuracy: 0.877000
Epoch 78, CIFAR-10 Batch 26:  Loss:     0.1503 Validation Accuracy: 0.873000
Epoch 78, CIFAR-10 Batch 27:  Loss:     0.1270 Validation Accuracy: 0.885800
Epoch 78, CIFAR-10 Batch 28:  Loss:     0.2221 Validation Accuracy: 0.871800
Epoch 78, CIFAR-10 Batch 29:  Loss:     0.1333 Validation Accuracy: 0.878200
Epoch 78, CIFAR-10 Batch 30:  Loss:     0.1288 Validation Accuracy: 0.874200
Epoch 78, CIFAR-10 Batch 31:  Loss:     0.1561 Validation Accuracy: 0.890000
Epoch 78, CIFAR-10 Batch 32:  Loss:     0.1456 Validation Accuracy: 0.875800
Epoch 78, CIFAR-10 Batch 33:  Loss:     0.1839 Validation Accuracy: 0.877000
Epoch 78, CIFAR-10 Batch 34:  Loss:     0.1983 Validation Accuracy: 0.872600
Epoch 78, CIFAR-10 Batch 35:  Loss:     0.1800 Validation Accuracy: 0.883400
Epoch 78, CIFAR-10 Batch 36:  Loss:     0.2426 Validation Accuracy: 0.886800
Epoch 78, CIFAR-10 Batch 37:  Loss:     0.1511 Validation Accuracy: 0.882200
Epoch 78, CIFAR-10 Batch 38:  Loss:     0.1444 Validation Accuracy: 0.867400
Epoch 78, CIFAR-10 Batch 39:  Loss:     0.1382 Validation Accuracy: 0.889400
Epoch 78, CIFAR-10 Batch 40:  Loss:     0.1684 Validation Accuracy: 0.861800
Epoch 78, CIFAR-10 Batch 41:  Loss:     0.1357 Validation Accuracy: 0.886000
Epoch 78, CIFAR-10 Batch 42:  Loss:     0.1834 Validation Accuracy: 0.881400
Epoch 78, CIFAR-10 Batch 43:  Loss:     0.2421 Validation Accuracy: 0.875400
Epoch 78, CIFAR-10 Batch 44:  Loss:     0.1577 Validation Accuracy: 0.868800
Epoch 78, CIFAR-10 Batch 45:  Loss:     0.1641 Validation Accuracy: 0.875600
Epoch 78, CIFAR-10 Batch 46:  Loss:     0.1628 Validation Accuracy: 0.886400
Epoch 78, CIFAR-10 Batch 47:  Loss:     0.1543 Validation Accuracy: 0.887200
Epoch 78, CIFAR-10 Batch 48:  Loss:     0.1685 Validation Accuracy: 0.866200
Epoch 78, CIFAR-10 Batch 49:  Loss:     0.2066 Validation Accuracy: 0.873200
Epoch 78, CIFAR-10 Batch 50:  Loss:     0.1666 Validation Accuracy: 0.884000
Epoch 79, CIFAR-10 Batch 1:  Loss:     0.1399 Validation Accuracy: 0.883600
Epoch 79, CIFAR-10 Batch 2:  Loss:     0.1825 Validation Accuracy: 0.879600
Epoch 79, CIFAR-10 Batch 3:  Loss:     0.1384 Validation Accuracy: 0.887600
Epoch 79, CIFAR-10 Batch 4:  Loss:     0.1451 Validation Accuracy: 0.875000
Epoch 79, CIFAR-10 Batch 5:  Loss:     0.1579 Validation Accuracy: 0.877400
Epoch 79, CIFAR-10 Batch 6:  Loss:     0.2729 Validation Accuracy: 0.883600
Epoch 79, CIFAR-10 Batch 7:  Loss:     0.1595 Validation Accuracy: 0.871400
Epoch 79, CIFAR-10 Batch 8:  Loss:     0.2020 Validation Accuracy: 0.881200
Epoch 79, CIFAR-10 Batch 9:  Loss:     0.1561 Validation Accuracy: 0.879800
Epoch 79, CIFAR-10 Batch 10:  Loss:     0.1317 Validation Accuracy: 0.887000
Epoch 79, CIFAR-10 Batch 11:  Loss:     0.1506 Validation Accuracy: 0.882200
Epoch 79, CIFAR-10 Batch 12:  Loss:     0.1436 Validation Accuracy: 0.881000
Epoch 79, CIFAR-10 Batch 13:  Loss:     0.1490 Validation Accuracy: 0.879600
Epoch 79, CIFAR-10 Batch 14:  Loss:     0.1812 Validation Accuracy: 0.883200
Epoch 79, CIFAR-10 Batch 15:  Loss:     0.1460 Validation Accuracy: 0.881000
Epoch 79, CIFAR-10 Batch 16:  Loss:     0.1539 Validation Accuracy: 0.874200
Epoch 79, CIFAR-10 Batch 17:  Loss:     0.1925 Validation Accuracy: 0.873200
Epoch 79, CIFAR-10 Batch 18:  Loss:     0.1392 Validation Accuracy: 0.870400
Epoch 79, CIFAR-10 Batch 19:  Loss:     0.1432 Validation Accuracy: 0.879400
Epoch 79, CIFAR-10 Batch 20:  Loss:     0.1863 Validation Accuracy: 0.880200
Epoch 79, CIFAR-10 Batch 21:  Loss:     0.1335 Validation Accuracy: 0.878200
Epoch 79, CIFAR-10 Batch 22:  Loss:     0.1806 Validation Accuracy: 0.879400
Epoch 79, CIFAR-10 Batch 23:  Loss:     0.1574 Validation Accuracy: 0.861400
Epoch 79, CIFAR-10 Batch 24:  Loss:     0.1672 Validation Accuracy: 0.888200
Epoch 79, CIFAR-10 Batch 25:  Loss:     0.1948 Validation Accuracy: 0.866000
Epoch 79, CIFAR-10 Batch 26:  Loss:     0.1672 Validation Accuracy: 0.889600
Epoch 79, CIFAR-10 Batch 27:  Loss:     0.1274 Validation Accuracy: 0.883200
Epoch 79, CIFAR-10 Batch 28:  Loss:     0.2049 Validation Accuracy: 0.874200
Epoch 79, CIFAR-10 Batch 29:  Loss:     0.1324 Validation Accuracy: 0.890000
Epoch 79, CIFAR-10 Batch 30:  Loss:     0.1346 Validation Accuracy: 0.878800
Epoch 79, CIFAR-10 Batch 31:  Loss:     0.1524 Validation Accuracy: 0.880600
Epoch 79, CIFAR-10 Batch 32:  Loss:     0.1460 Validation Accuracy: 0.874800
Epoch 79, CIFAR-10 Batch 33:  Loss:     0.2260 Validation Accuracy: 0.870400
Epoch 79, CIFAR-10 Batch 34:  Loss:     0.2144 Validation Accuracy: 0.875400
Epoch 79, CIFAR-10 Batch 35:  Loss:     0.1772 Validation Accuracy: 0.888000
Epoch 79, CIFAR-10 Batch 36:  Loss:     0.2316 Validation Accuracy: 0.870200
Epoch 79, CIFAR-10 Batch 37:  Loss:     0.1508 Validation Accuracy: 0.881400
Epoch 79, CIFAR-10 Batch 38:  Loss:     0.1449 Validation Accuracy: 0.863400
Epoch 79, CIFAR-10 Batch 39:  Loss:     0.1401 Validation Accuracy: 0.871600
Epoch 79, CIFAR-10 Batch 40:  Loss:     0.1476 Validation Accuracy: 0.882800
Epoch 79, CIFAR-10 Batch 41:  Loss:     0.1751 Validation Accuracy: 0.880600
Epoch 79, CIFAR-10 Batch 42:  Loss:     0.2037 Validation Accuracy: 0.868600
Epoch 79, CIFAR-10 Batch 43:  Loss:     0.2393 Validation Accuracy: 0.868800
Epoch 79, CIFAR-10 Batch 44:  Loss:     0.1576 Validation Accuracy: 0.870600
Epoch 79, CIFAR-10 Batch 45:  Loss:     0.1512 Validation Accuracy: 0.884000
Epoch 79, CIFAR-10 Batch 46:  Loss:     0.1528 Validation Accuracy: 0.874200
Epoch 79, CIFAR-10 Batch 47:  Loss:     0.1753 Validation Accuracy: 0.883600
Epoch 79, CIFAR-10 Batch 48:  Loss:     0.1712 Validation Accuracy: 0.888200
Epoch 79, CIFAR-10 Batch 49:  Loss:     0.1912 Validation Accuracy: 0.883000
Epoch 79, CIFAR-10 Batch 50:  Loss:     0.1566 Validation Accuracy: 0.882600
Epoch 80, CIFAR-10 Batch 1:  Loss:     0.1560 Validation Accuracy: 0.886600
Epoch 80, CIFAR-10 Batch 2:  Loss:     0.1345 Validation Accuracy: 0.883800
Epoch 80, CIFAR-10 Batch 3:  Loss:     0.1746 Validation Accuracy: 0.882800
Epoch 80, CIFAR-10 Batch 4:  Loss:     0.1500 Validation Accuracy: 0.888400
Epoch 80, CIFAR-10 Batch 5:  Loss:     0.1618 Validation Accuracy: 0.879400
Epoch 80, CIFAR-10 Batch 6:  Loss:     0.2303 Validation Accuracy: 0.886800
Epoch 80, CIFAR-10 Batch 7:  Loss:     0.1391 Validation Accuracy: 0.867200
Epoch 80, CIFAR-10 Batch 8:  Loss:     0.1730 Validation Accuracy: 0.879800
Epoch 80, CIFAR-10 Batch 9:  Loss:     0.1657 Validation Accuracy: 0.877800
Epoch 80, CIFAR-10 Batch 10:  Loss:     0.1374 Validation Accuracy: 0.881000
Epoch 80, CIFAR-10 Batch 11:  Loss:     0.1489 Validation Accuracy: 0.879800
Epoch 80, CIFAR-10 Batch 12:  Loss:     0.1573 Validation Accuracy: 0.882200
Epoch 80, CIFAR-10 Batch 13:  Loss:     0.1440 Validation Accuracy: 0.884800
Epoch 80, CIFAR-10 Batch 14:  Loss:     0.1684 Validation Accuracy: 0.874800
Epoch 80, CIFAR-10 Batch 15:  Loss:     0.1496 Validation Accuracy: 0.890000
Epoch 80, CIFAR-10 Batch 16:  Loss:     0.1773 Validation Accuracy: 0.874200
Epoch 80, CIFAR-10 Batch 17:  Loss:     0.1660 Validation Accuracy: 0.883600
Epoch 80, CIFAR-10 Batch 18:  Loss:     0.1496 Validation Accuracy: 0.886600
Epoch 80, CIFAR-10 Batch 19:  Loss:     0.1422 Validation Accuracy: 0.878200
Epoch 80, CIFAR-10 Batch 20:  Loss:     0.1929 Validation Accuracy: 0.883800
Epoch 80, CIFAR-10 Batch 21:  Loss:     0.1417 Validation Accuracy: 0.872800
Epoch 80, CIFAR-10 Batch 22:  Loss:     0.1651 Validation Accuracy: 0.882200
Epoch 80, CIFAR-10 Batch 23:  Loss:     0.1628 Validation Accuracy: 0.884000
Epoch 80, CIFAR-10 Batch 24:  Loss:     0.1411 Validation Accuracy: 0.865200
Epoch 80, CIFAR-10 Batch 25:  Loss:     0.1587 Validation Accuracy: 0.857000
Epoch 80, CIFAR-10 Batch 26:  Loss:     0.1635 Validation Accuracy: 0.877400
Epoch 80, CIFAR-10 Batch 27:  Loss:     0.1325 Validation Accuracy: 0.864200
Epoch 80, CIFAR-10 Batch 28:  Loss:     0.2284 Validation Accuracy: 0.884800
Epoch 80, CIFAR-10 Batch 29:  Loss:     0.1376 Validation Accuracy: 0.878400
Epoch 80, CIFAR-10 Batch 30:  Loss:     0.1374 Validation Accuracy: 0.875400
Epoch 80, CIFAR-10 Batch 31:  Loss:     0.1292 Validation Accuracy: 0.884600
Epoch 80, CIFAR-10 Batch 32:  Loss:     0.1453 Validation Accuracy: 0.884600
Epoch 80, CIFAR-10 Batch 33:  Loss:     0.2176 Validation Accuracy: 0.879000
Epoch 80, CIFAR-10 Batch 34:  Loss:     0.2199 Validation Accuracy: 0.872800
Epoch 80, CIFAR-10 Batch 35:  Loss:     0.1915 Validation Accuracy: 0.882800
Epoch 80, CIFAR-10 Batch 36:  Loss:     0.2226 Validation Accuracy: 0.880800
Epoch 80, CIFAR-10 Batch 37:  Loss:     0.1708 Validation Accuracy: 0.875000
Epoch 80, CIFAR-10 Batch 38:  Loss:     0.1367 Validation Accuracy: 0.882000
Epoch 80, CIFAR-10 Batch 39:  Loss:     0.1291 Validation Accuracy: 0.877400
Epoch 80, CIFAR-10 Batch 40:  Loss:     0.1603 Validation Accuracy: 0.878000
Epoch 80, CIFAR-10 Batch 41:  Loss:     0.1417 Validation Accuracy: 0.882600
Epoch 80, CIFAR-10 Batch 42:  Loss:     0.1661 Validation Accuracy: 0.878200
Epoch 80, CIFAR-10 Batch 43:  Loss:     0.2255 Validation Accuracy: 0.875400
Epoch 80, CIFAR-10 Batch 44:  Loss:     0.1689 Validation Accuracy: 0.864400
Epoch 80, CIFAR-10 Batch 45:  Loss:     0.1363 Validation Accuracy: 0.873600
Epoch 80, CIFAR-10 Batch 46:  Loss:     0.1628 Validation Accuracy: 0.886400
Epoch 80, CIFAR-10 Batch 47:  Loss:     0.1462 Validation Accuracy: 0.882000
Epoch 80, CIFAR-10 Batch 48:  Loss:     0.1748 Validation Accuracy: 0.878600
Epoch 80, CIFAR-10 Batch 49:  Loss:     0.1738 Validation Accuracy: 0.874400
Epoch 80, CIFAR-10 Batch 50:  Loss:     0.1673 Validation Accuracy: 0.857200
Epoch 81, CIFAR-10 Batch 1:  Loss:     0.1519 Validation Accuracy: 0.875400
Epoch 81, CIFAR-10 Batch 2:  Loss:     0.1362 Validation Accuracy: 0.881000
Epoch 81, CIFAR-10 Batch 3:  Loss:     0.1418 Validation Accuracy: 0.881800
Epoch 81, CIFAR-10 Batch 4:  Loss:     0.1331 Validation Accuracy: 0.866400
Epoch 81, CIFAR-10 Batch 5:  Loss:     0.1819 Validation Accuracy: 0.882600
Epoch 81, CIFAR-10 Batch 6:  Loss:     0.2291 Validation Accuracy: 0.882800
Epoch 81, CIFAR-10 Batch 7:  Loss:     0.1610 Validation Accuracy: 0.874200
Epoch 81, CIFAR-10 Batch 8:  Loss:     0.2023 Validation Accuracy: 0.889000
Epoch 81, CIFAR-10 Batch 9:  Loss:     0.1463 Validation Accuracy: 0.882800
Epoch 81, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.880400
Epoch 81, CIFAR-10 Batch 11:  Loss:     0.1571 Validation Accuracy: 0.877000
Epoch 81, CIFAR-10 Batch 12:  Loss:     0.2154 Validation Accuracy: 0.874200
Epoch 81, CIFAR-10 Batch 13:  Loss:     0.1560 Validation Accuracy: 0.876200
Epoch 81, CIFAR-10 Batch 14:  Loss:     0.1571 Validation Accuracy: 0.875000
Epoch 81, CIFAR-10 Batch 15:  Loss:     0.1392 Validation Accuracy: 0.878000
Epoch 81, CIFAR-10 Batch 16:  Loss:     0.1575 Validation Accuracy: 0.874400
Epoch 81, CIFAR-10 Batch 17:  Loss:     0.1782 Validation Accuracy: 0.884600
Epoch 81, CIFAR-10 Batch 18:  Loss:     0.1523 Validation Accuracy: 0.873800
Epoch 81, CIFAR-10 Batch 19:  Loss:     0.1299 Validation Accuracy: 0.881200
Epoch 81, CIFAR-10 Batch 20:  Loss:     0.2070 Validation Accuracy: 0.883600
Epoch 81, CIFAR-10 Batch 21:  Loss:     0.1505 Validation Accuracy: 0.887000
Epoch 81, CIFAR-10 Batch 22:  Loss:     0.1584 Validation Accuracy: 0.876800
Epoch 81, CIFAR-10 Batch 23:  Loss:     0.1469 Validation Accuracy: 0.888200
Epoch 81, CIFAR-10 Batch 24:  Loss:     0.1484 Validation Accuracy: 0.883800
Epoch 81, CIFAR-10 Batch 25:  Loss:     0.1953 Validation Accuracy: 0.860200
Epoch 81, CIFAR-10 Batch 26:  Loss:     0.1609 Validation Accuracy: 0.882600
Epoch 81, CIFAR-10 Batch 27:  Loss:     0.1315 Validation Accuracy: 0.868600
Epoch 81, CIFAR-10 Batch 28:  Loss:     0.2320 Validation Accuracy: 0.883400
Epoch 81, CIFAR-10 Batch 29:  Loss:     0.1398 Validation Accuracy: 0.878400
Epoch 81, CIFAR-10 Batch 30:  Loss:     0.1390 Validation Accuracy: 0.884200
Epoch 81, CIFAR-10 Batch 31:  Loss:     0.1586 Validation Accuracy: 0.880000
Epoch 81, CIFAR-10 Batch 32:  Loss:     0.1411 Validation Accuracy: 0.880800
Epoch 81, CIFAR-10 Batch 33:  Loss:     0.2079 Validation Accuracy: 0.883200
Epoch 81, CIFAR-10 Batch 34:  Loss:     0.2139 Validation Accuracy: 0.874000
Epoch 81, CIFAR-10 Batch 35:  Loss:     0.1933 Validation Accuracy: 0.878600
Epoch 81, CIFAR-10 Batch 36:  Loss:     0.2323 Validation Accuracy: 0.865000
Epoch 81, CIFAR-10 Batch 37:  Loss:     0.1587 Validation Accuracy: 0.871400
Epoch 81, CIFAR-10 Batch 38:  Loss:     0.1348 Validation Accuracy: 0.881000
Epoch 81, CIFAR-10 Batch 39:  Loss:     0.1291 Validation Accuracy: 0.869000
Epoch 81, CIFAR-10 Batch 40:  Loss:     0.1770 Validation Accuracy: 0.870800
Epoch 81, CIFAR-10 Batch 41:  Loss:     0.1550 Validation Accuracy: 0.890800
Epoch 81, CIFAR-10 Batch 42:  Loss:     0.1478 Validation Accuracy: 0.866000
Epoch 81, CIFAR-10 Batch 43:  Loss:     0.2417 Validation Accuracy: 0.876600
Epoch 81, CIFAR-10 Batch 44:  Loss:     0.1435 Validation Accuracy: 0.885600
Epoch 81, CIFAR-10 Batch 45:  Loss:     0.1388 Validation Accuracy: 0.875600
Epoch 81, CIFAR-10 Batch 46:  Loss:     0.1418 Validation Accuracy: 0.881200
Epoch 81, CIFAR-10 Batch 47:  Loss:     0.1699 Validation Accuracy: 0.889600
Epoch 81, CIFAR-10 Batch 48:  Loss:     0.1652 Validation Accuracy: 0.886600
Epoch 81, CIFAR-10 Batch 49:  Loss:     0.1849 Validation Accuracy: 0.874400
Epoch 81, CIFAR-10 Batch 50:  Loss:     0.1682 Validation Accuracy: 0.887600
Epoch 82, CIFAR-10 Batch 1:  Loss:     0.1964 Validation Accuracy: 0.890400
Epoch 82, CIFAR-10 Batch 2:  Loss:     0.1493 Validation Accuracy: 0.893400
Epoch 82, CIFAR-10 Batch 3:  Loss:     0.1385 Validation Accuracy: 0.892000
Epoch 82, CIFAR-10 Batch 4:  Loss:     0.1476 Validation Accuracy: 0.895400
Epoch 82, CIFAR-10 Batch 5:  Loss:     0.1985 Validation Accuracy: 0.895400
Epoch 82, CIFAR-10 Batch 6:  Loss:     0.2725 Validation Accuracy: 0.899200
Epoch 82, CIFAR-10 Batch 7:  Loss:     0.1790 Validation Accuracy: 0.898400
Epoch 82, CIFAR-10 Batch 8:  Loss:     0.3118 Validation Accuracy: 0.899000
Epoch 82, CIFAR-10 Batch 9:  Loss:     0.2199 Validation Accuracy: 0.898000
Epoch 82, CIFAR-10 Batch 10:  Loss:     0.1358 Validation Accuracy: 0.896200
Epoch 82, CIFAR-10 Batch 11:  Loss:     0.1516 Validation Accuracy: 0.898400
Epoch 82, CIFAR-10 Batch 12:  Loss:     0.1622 Validation Accuracy: 0.897000
Epoch 82, CIFAR-10 Batch 13:  Loss:     0.1626 Validation Accuracy: 0.896200
Epoch 82, CIFAR-10 Batch 14:  Loss:     0.1589 Validation Accuracy: 0.902600
Epoch 82, CIFAR-10 Batch 15:  Loss:     0.1382 Validation Accuracy: 0.900000
Epoch 82, CIFAR-10 Batch 16:  Loss:     0.1798 Validation Accuracy: 0.898800
Epoch 82, CIFAR-10 Batch 17:  Loss:     0.2171 Validation Accuracy: 0.897600
Epoch 82, CIFAR-10 Batch 18:  Loss:     0.1361 Validation Accuracy: 0.898600
Epoch 82, CIFAR-10 Batch 19:  Loss:     0.1443 Validation Accuracy: 0.899200
Epoch 82, CIFAR-10 Batch 20:  Loss:     0.1611 Validation Accuracy: 0.900400
Epoch 82, CIFAR-10 Batch 21:  Loss:     0.1505 Validation Accuracy: 0.900600
Epoch 82, CIFAR-10 Batch 22:  Loss:     0.1542 Validation Accuracy: 0.901400
Epoch 82, CIFAR-10 Batch 23:  Loss:     0.1374 Validation Accuracy: 0.897800
Epoch 82, CIFAR-10 Batch 24:  Loss:     0.1457 Validation Accuracy: 0.901000
Epoch 82, CIFAR-10 Batch 25:  Loss:     0.1735 Validation Accuracy: 0.900000
Epoch 82, CIFAR-10 Batch 26:  Loss:     0.1437 Validation Accuracy: 0.901200
Epoch 82, CIFAR-10 Batch 27:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 82, CIFAR-10 Batch 28:  Loss:     0.2094 Validation Accuracy: 0.900200
Epoch 82, CIFAR-10 Batch 29:  Loss:     0.1530 Validation Accuracy: 0.900200
Epoch 82, CIFAR-10 Batch 30:  Loss:     0.1371 Validation Accuracy: 0.900600
Epoch 82, CIFAR-10 Batch 31:  Loss:     0.1346 Validation Accuracy: 0.901200
Epoch 82, CIFAR-10 Batch 32:  Loss:     0.1438 Validation Accuracy: 0.901400
Epoch 82, CIFAR-10 Batch 33:  Loss:     0.1758 Validation Accuracy: 0.903400
Epoch 82, CIFAR-10 Batch 34:  Loss:     0.1779 Validation Accuracy: 0.902400
Epoch 82, CIFAR-10 Batch 35:  Loss:     0.1688 Validation Accuracy: 0.902200
Epoch 82, CIFAR-10 Batch 36:  Loss:     0.2030 Validation Accuracy: 0.897000
Epoch 82, CIFAR-10 Batch 37:  Loss:     0.1435 Validation Accuracy: 0.899000
Epoch 82, CIFAR-10 Batch 38:  Loss:     0.1201 Validation Accuracy: 0.896800
Epoch 82, CIFAR-10 Batch 39:  Loss:     0.1268 Validation Accuracy: 0.900600
Epoch 82, CIFAR-10 Batch 40:  Loss:     0.1711 Validation Accuracy: 0.899800
Epoch 82, CIFAR-10 Batch 41:  Loss:     0.1320 Validation Accuracy: 0.898400
Epoch 82, CIFAR-10 Batch 42:  Loss:     0.1388 Validation Accuracy: 0.899800
Epoch 82, CIFAR-10 Batch 43:  Loss:     0.1532 Validation Accuracy: 0.902800
Epoch 82, CIFAR-10 Batch 44:  Loss:     0.1298 Validation Accuracy: 0.900600
Epoch 82, CIFAR-10 Batch 45:  Loss:     0.1232 Validation Accuracy: 0.902600
Epoch 82, CIFAR-10 Batch 46:  Loss:     0.1259 Validation Accuracy: 0.898400
Epoch 82, CIFAR-10 Batch 47:  Loss:     0.1441 Validation Accuracy: 0.900400
Epoch 82, CIFAR-10 Batch 48:  Loss:     0.1322 Validation Accuracy: 0.899200
Epoch 82, CIFAR-10 Batch 49:  Loss:     0.1602 Validation Accuracy: 0.900000
Epoch 82, CIFAR-10 Batch 50:  Loss:     0.1332 Validation Accuracy: 0.899200
Epoch 83, CIFAR-10 Batch 1:  Loss:     0.1372 Validation Accuracy: 0.900200
Epoch 83, CIFAR-10 Batch 2:  Loss:     0.1383 Validation Accuracy: 0.899000
Epoch 83, CIFAR-10 Batch 3:  Loss:     0.1232 Validation Accuracy: 0.899800
Epoch 83, CIFAR-10 Batch 4:  Loss:     0.1333 Validation Accuracy: 0.900200
Epoch 83, CIFAR-10 Batch 5:  Loss:     0.1780 Validation Accuracy: 0.900600
Epoch 83, CIFAR-10 Batch 6:  Loss:     0.2225 Validation Accuracy: 0.900400
Epoch 83, CIFAR-10 Batch 7:  Loss:     0.1895 Validation Accuracy: 0.899800
Epoch 83, CIFAR-10 Batch 8:  Loss:     0.3206 Validation Accuracy: 0.901400
Epoch 83, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 83, CIFAR-10 Batch 10:  Loss:     0.1274 Validation Accuracy: 0.901600
Epoch 83, CIFAR-10 Batch 11:  Loss:     0.1378 Validation Accuracy: 0.902400
Epoch 83, CIFAR-10 Batch 12:  Loss:     0.1366 Validation Accuracy: 0.903000
Epoch 83, CIFAR-10 Batch 13:  Loss:     0.1558 Validation Accuracy: 0.903200
Epoch 83, CIFAR-10 Batch 14:  Loss:     0.1413 Validation Accuracy: 0.903600
Epoch 83, CIFAR-10 Batch 15:  Loss:     0.1279 Validation Accuracy: 0.903600
Epoch 83, CIFAR-10 Batch 16:  Loss:     0.1585 Validation Accuracy: 0.903000
Epoch 83, CIFAR-10 Batch 17:  Loss:     0.1991 Validation Accuracy: 0.903400
Epoch 83, CIFAR-10 Batch 18:  Loss:     0.1334 Validation Accuracy: 0.902000
Epoch 83, CIFAR-10 Batch 19:  Loss:     0.1380 Validation Accuracy: 0.903000
Epoch 83, CIFAR-10 Batch 20:  Loss:     0.1548 Validation Accuracy: 0.902200
Epoch 83, CIFAR-10 Batch 21:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 83, CIFAR-10 Batch 22:  Loss:     0.1556 Validation Accuracy: 0.903000
Epoch 83, CIFAR-10 Batch 23:  Loss:     0.1290 Validation Accuracy: 0.902800
Epoch 83, CIFAR-10 Batch 24:  Loss:     0.1345 Validation Accuracy: 0.902800
Epoch 83, CIFAR-10 Batch 25:  Loss:     0.1562 Validation Accuracy: 0.902400
Epoch 83, CIFAR-10 Batch 26:  Loss:     0.1328 Validation Accuracy: 0.903400
Epoch 83, CIFAR-10 Batch 27:  Loss:     0.1166 Validation Accuracy: 0.902600
Epoch 83, CIFAR-10 Batch 28:  Loss:     0.1936 Validation Accuracy: 0.902600
Epoch 83, CIFAR-10 Batch 29:  Loss:     0.1487 Validation Accuracy: 0.902200
Epoch 83, CIFAR-10 Batch 30:  Loss:     0.1382 Validation Accuracy: 0.903000
Epoch 83, CIFAR-10 Batch 31:  Loss:     0.1318 Validation Accuracy: 0.902600
Epoch 83, CIFAR-10 Batch 32:  Loss:     0.1379 Validation Accuracy: 0.901800
Epoch 83, CIFAR-10 Batch 33:  Loss:     0.1619 Validation Accuracy: 0.902800
Epoch 83, CIFAR-10 Batch 34:  Loss:     0.1626 Validation Accuracy: 0.902000
Epoch 83, CIFAR-10 Batch 35:  Loss:     0.1631 Validation Accuracy: 0.901200
Epoch 83, CIFAR-10 Batch 36:  Loss:     0.1979 Validation Accuracy: 0.901200
Epoch 83, CIFAR-10 Batch 37:  Loss:     0.1422 Validation Accuracy: 0.901600
Epoch 83, CIFAR-10 Batch 38:  Loss:     0.1185 Validation Accuracy: 0.900800
Epoch 83, CIFAR-10 Batch 39:  Loss:     0.1224 Validation Accuracy: 0.901800
Epoch 83, CIFAR-10 Batch 40:  Loss:     0.1513 Validation Accuracy: 0.901200
Epoch 83, CIFAR-10 Batch 41:  Loss:     0.1260 Validation Accuracy: 0.902200
Epoch 83, CIFAR-10 Batch 42:  Loss:     0.1394 Validation Accuracy: 0.901200
Epoch 83, CIFAR-10 Batch 43:  Loss:     0.1473 Validation Accuracy: 0.901600
Epoch 83, CIFAR-10 Batch 44:  Loss:     0.1225 Validation Accuracy: 0.901600
Epoch 83, CIFAR-10 Batch 45:  Loss:     0.1174 Validation Accuracy: 0.901200
Epoch 83, CIFAR-10 Batch 46:  Loss:     0.1220 Validation Accuracy: 0.901600
Epoch 83, CIFAR-10 Batch 47:  Loss:     0.1320 Validation Accuracy: 0.902600
Epoch 83, CIFAR-10 Batch 48:  Loss:     0.1284 Validation Accuracy: 0.902400
Epoch 83, CIFAR-10 Batch 49:  Loss:     0.1551 Validation Accuracy: 0.900800
Epoch 83, CIFAR-10 Batch 50:  Loss:     0.1347 Validation Accuracy: 0.902200
Epoch 84, CIFAR-10 Batch 1:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 84, CIFAR-10 Batch 2:  Loss:     0.1385 Validation Accuracy: 0.901800
Epoch 84, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902600
Epoch 84, CIFAR-10 Batch 4:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 84, CIFAR-10 Batch 5:  Loss:     0.1686 Validation Accuracy: 0.902000
Epoch 84, CIFAR-10 Batch 6:  Loss:     0.2176 Validation Accuracy: 0.901600
Epoch 84, CIFAR-10 Batch 7:  Loss:     0.1841 Validation Accuracy: 0.902000
Epoch 84, CIFAR-10 Batch 8:  Loss:     0.2933 Validation Accuracy: 0.901400
Epoch 84, CIFAR-10 Batch 9:  Loss:     0.1799 Validation Accuracy: 0.901800
Epoch 84, CIFAR-10 Batch 10:  Loss:     0.1266 Validation Accuracy: 0.901400
Epoch 84, CIFAR-10 Batch 11:  Loss:     0.1342 Validation Accuracy: 0.902200
Epoch 84, CIFAR-10 Batch 12:  Loss:     0.1336 Validation Accuracy: 0.902400
Epoch 84, CIFAR-10 Batch 13:  Loss:     0.1473 Validation Accuracy: 0.902800
Epoch 84, CIFAR-10 Batch 14:  Loss:     0.1401 Validation Accuracy: 0.902800
Epoch 84, CIFAR-10 Batch 15:  Loss:     0.1270 Validation Accuracy: 0.902400
Epoch 84, CIFAR-10 Batch 16:  Loss:     0.1540 Validation Accuracy: 0.902400
Epoch 84, CIFAR-10 Batch 17:  Loss:     0.1921 Validation Accuracy: 0.902800
Epoch 84, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 84, CIFAR-10 Batch 19:  Loss:     0.1370 Validation Accuracy: 0.901400
Epoch 84, CIFAR-10 Batch 20:  Loss:     0.1541 Validation Accuracy: 0.902800
Epoch 84, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902800
Epoch 84, CIFAR-10 Batch 22:  Loss:     0.1504 Validation Accuracy: 0.903200
Epoch 84, CIFAR-10 Batch 23:  Loss:     0.1274 Validation Accuracy: 0.903400
Epoch 84, CIFAR-10 Batch 24:  Loss:     0.1350 Validation Accuracy: 0.902800
Epoch 84, CIFAR-10 Batch 25:  Loss:     0.1542 Validation Accuracy: 0.903200
Epoch 84, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903400
Epoch 84, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 84, CIFAR-10 Batch 28:  Loss:     0.1922 Validation Accuracy: 0.902000
Epoch 84, CIFAR-10 Batch 29:  Loss:     0.1495 Validation Accuracy: 0.902200
Epoch 84, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903400
Epoch 84, CIFAR-10 Batch 31:  Loss:     0.1317 Validation Accuracy: 0.902200
Epoch 84, CIFAR-10 Batch 32:  Loss:     0.1341 Validation Accuracy: 0.902200
Epoch 84, CIFAR-10 Batch 33:  Loss:     0.1610 Validation Accuracy: 0.901800
Epoch 84, CIFAR-10 Batch 34:  Loss:     0.1597 Validation Accuracy: 0.902000
Epoch 84, CIFAR-10 Batch 35:  Loss:     0.1596 Validation Accuracy: 0.901800
Epoch 84, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902200
Epoch 84, CIFAR-10 Batch 37:  Loss:     0.1433 Validation Accuracy: 0.902200
Epoch 84, CIFAR-10 Batch 38:  Loss:     0.1180 Validation Accuracy: 0.901200
Epoch 84, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 84, CIFAR-10 Batch 40:  Loss:     0.1518 Validation Accuracy: 0.902000
Epoch 84, CIFAR-10 Batch 41:  Loss:     0.1251 Validation Accuracy: 0.902200
Epoch 84, CIFAR-10 Batch 42:  Loss:     0.1386 Validation Accuracy: 0.902400
Epoch 84, CIFAR-10 Batch 43:  Loss:     0.1435 Validation Accuracy: 0.902600
Epoch 84, CIFAR-10 Batch 44:  Loss:     0.1219 Validation Accuracy: 0.903000
Epoch 84, CIFAR-10 Batch 45:  Loss:     0.1172 Validation Accuracy: 0.903200
Epoch 84, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 84, CIFAR-10 Batch 47:  Loss:     0.1313 Validation Accuracy: 0.902400
Epoch 84, CIFAR-10 Batch 48:  Loss:     0.1284 Validation Accuracy: 0.901600
Epoch 84, CIFAR-10 Batch 49:  Loss:     0.1551 Validation Accuracy: 0.901600
Epoch 84, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 85, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901400
Epoch 85, CIFAR-10 Batch 2:  Loss:     0.1383 Validation Accuracy: 0.901400
Epoch 85, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 85, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 85, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 85, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 85, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 85, CIFAR-10 Batch 8:  Loss:     0.2929 Validation Accuracy: 0.901600
Epoch 85, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 85, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 85, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901600
Epoch 85, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 85, CIFAR-10 Batch 13:  Loss:     0.1467 Validation Accuracy: 0.901600
Epoch 85, CIFAR-10 Batch 14:  Loss:     0.1397 Validation Accuracy: 0.902600
Epoch 85, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902400
Epoch 85, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 85, CIFAR-10 Batch 17:  Loss:     0.1911 Validation Accuracy: 0.902800
Epoch 85, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 85, CIFAR-10 Batch 19:  Loss:     0.1366 Validation Accuracy: 0.902000
Epoch 85, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902800
Epoch 85, CIFAR-10 Batch 21:  Loss:     0.1321 Validation Accuracy: 0.902600
Epoch 85, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 85, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 85, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 85, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 85, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 85, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903200
Epoch 85, CIFAR-10 Batch 28:  Loss:     0.1922 Validation Accuracy: 0.902200
Epoch 85, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902200
Epoch 85, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 85, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 85, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902400
Epoch 85, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.901800
Epoch 85, CIFAR-10 Batch 34:  Loss:     0.1593 Validation Accuracy: 0.901600
Epoch 85, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 85, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 85, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902200
Epoch 85, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 85, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 85, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 85, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 85, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 85, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 85, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 85, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 85, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 85, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 85, CIFAR-10 Batch 48:  Loss:     0.1284 Validation Accuracy: 0.901400
Epoch 85, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 85, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 86, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 86, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 86, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 86, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 86, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 86, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 86, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901800
Epoch 86, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.902000
Epoch 86, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 86, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 86, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 86, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 86, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 86, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 86, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 86, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 86, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 86, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 86, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 86, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 86, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 86, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 86, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 86, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 86, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 86, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 86, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902400
Epoch 86, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 86, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 86, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 86, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 86, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 86, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 86, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 86, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 86, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902200
Epoch 86, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902200
Epoch 86, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 86, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 86, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 86, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 86, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 86, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 86, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 86, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 86, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 86, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 86, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 86, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 86, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 87, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 87, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 87, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 87, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 87, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 87, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901400
Epoch 87, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 87, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 87, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 87, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 87, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 87, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 87, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901800
Epoch 87, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 87, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 87, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 87, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902200
Epoch 87, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 87, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902200
Epoch 87, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902200
Epoch 87, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 87, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 87, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 87, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 87, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 87, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 87, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903200
Epoch 87, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902400
Epoch 87, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 87, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 87, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 87, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 87, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 87, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 87, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901400
Epoch 87, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 87, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902800
Epoch 87, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 87, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 87, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 87, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 87, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 87, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 87, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 87, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 87, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 87, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 87, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 87, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 87, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 88, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 88, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 88, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 88, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901600
Epoch 88, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 88, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 88, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 88, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901000
Epoch 88, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 88, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902000
Epoch 88, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 88, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902400
Epoch 88, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 88, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 88, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 88, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 88, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 88, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 88, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902200
Epoch 88, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902800
Epoch 88, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 88, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.903000
Epoch 88, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 88, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 88, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 88, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 88, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 88, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 88, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901600
Epoch 88, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 88, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 88, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 88, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 88, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 88, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 88, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902200
Epoch 88, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 88, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 88, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 88, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 88, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 88, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 88, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 88, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902600
Epoch 88, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 88, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 88, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 88, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 88, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 88, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 89, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 89, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 89, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 89, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901600
Epoch 89, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 89, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 89, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 89, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 89, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 89, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 89, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 89, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 89, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 89, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903200
Epoch 89, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902400
Epoch 89, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 89, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 89, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 89, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 89, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 89, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902800
Epoch 89, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 89, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903600
Epoch 89, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 89, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 89, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903600
Epoch 89, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902400
Epoch 89, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 89, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 89, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903200
Epoch 89, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 89, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 89, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 89, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 89, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901600
Epoch 89, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 89, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 89, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 89, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 89, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 89, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 89, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 89, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 89, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 89, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 89, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 89, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 89, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902000
Epoch 89, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901400
Epoch 89, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 90, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 90, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 90, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 90, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 90, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 90, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 90, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 90, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 90, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 90, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901200
Epoch 90, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 90, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 90, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901800
Epoch 90, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 90, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 90, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 90, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 90, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 90, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 90, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 90, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 90, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 90, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 90, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 90, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 90, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 90, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 90, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 90, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901600
Epoch 90, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902600
Epoch 90, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 90, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 90, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 90, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 90, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 90, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 90, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 90, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 90, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 90, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 90, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901400
Epoch 90, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902400
Epoch 90, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 90, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 90, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 90, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 90, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902600
Epoch 90, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 90, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 90, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 91, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 91, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901600
Epoch 91, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.901800
Epoch 91, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901000
Epoch 91, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 91, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 91, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 91, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 91, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 91, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902000
Epoch 91, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 91, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 91, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902600
Epoch 91, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902400
Epoch 91, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 91, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 91, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 91, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 91, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902200
Epoch 91, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 91, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 91, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.903000
Epoch 91, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903600
Epoch 91, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.903200
Epoch 91, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 91, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 91, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 91, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 91, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 91, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 91, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 91, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901600
Epoch 91, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 91, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 91, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 91, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902200
Epoch 91, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902800
Epoch 91, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.902000
Epoch 91, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 91, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902600
Epoch 91, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 91, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 91, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.903000
Epoch 91, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902600
Epoch 91, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 91, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 91, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 91, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 91, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 91, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 92, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 92, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 92, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 92, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 92, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 92, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 92, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 92, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 92, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 92, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 92, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 92, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 92, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 92, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 92, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 92, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 92, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 92, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 92, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 92, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902800
Epoch 92, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 92, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 92, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.902800
Epoch 92, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 92, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 92, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 92, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 92, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 92, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 92, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 92, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 92, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 92, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902800
Epoch 92, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 92, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 92, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 92, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 92, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.902000
Epoch 92, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 92, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 92, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901400
Epoch 92, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 92, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902200
Epoch 92, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 92, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.902600
Epoch 92, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902000
Epoch 92, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 92, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901400
Epoch 92, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 92, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 93, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 93, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 93, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 93, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 93, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 93, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901400
Epoch 93, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.902000
Epoch 93, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901200
Epoch 93, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 93, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901200
Epoch 93, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 93, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.901800
Epoch 93, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 93, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902600
Epoch 93, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902400
Epoch 93, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902000
Epoch 93, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 93, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902200
Epoch 93, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901400
Epoch 93, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 93, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 93, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 93, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 93, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 93, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 93, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 93, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 93, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 93, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 93, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 93, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 93, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 93, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 93, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902400
Epoch 93, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 93, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902800
Epoch 93, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 93, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 93, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 93, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.901800
Epoch 93, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 93, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 93, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 93, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 93, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 93, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 93, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 93, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 93, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901400
Epoch 93, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 94, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 94, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 94, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 94, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 94, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 94, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 94, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 94, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 94, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 94, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 94, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 94, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902400
Epoch 94, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 94, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 94, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 94, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902000
Epoch 94, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902200
Epoch 94, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 94, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 94, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902800
Epoch 94, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 94, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.903000
Epoch 94, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 94, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 94, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 94, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 94, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 94, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 94, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 94, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 94, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 94, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 94, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.901600
Epoch 94, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901200
Epoch 94, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 94, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902200
Epoch 94, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902200
Epoch 94, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 94, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 94, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902600
Epoch 94, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 94, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 94, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 94, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 94, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 94, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 94, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 94, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 94, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 94, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 95, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 95, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 95, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 95, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 95, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 95, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 95, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 95, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901200
Epoch 95, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 95, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 95, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 95, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902400
Epoch 95, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 95, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902600
Epoch 95, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903200
Epoch 95, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 95, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902200
Epoch 95, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 95, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 95, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 95, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 95, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 95, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 95, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 95, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 95, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903400
Epoch 95, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 95, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 95, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 95, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903200
Epoch 95, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 95, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 95, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 95, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 95, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 95, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902000
Epoch 95, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 95, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 95, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 95, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.901800
Epoch 95, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 95, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 95, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 95, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 95, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 95, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 95, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 95, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902200
Epoch 95, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 95, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 96, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 96, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 96, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902200
Epoch 96, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901600
Epoch 96, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 96, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 96, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 96, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.902000
Epoch 96, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.902000
Epoch 96, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902200
Epoch 96, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 96, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 96, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 96, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903200
Epoch 96, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 96, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 96, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 96, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 96, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 96, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902800
Epoch 96, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 96, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 96, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 96, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 96, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 96, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903400
Epoch 96, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 96, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 96, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 96, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902600
Epoch 96, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 96, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 96, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 96, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 96, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 96, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 96, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 96, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 96, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 96, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 96, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 96, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 96, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 96, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 96, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 96, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902600
Epoch 96, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 96, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 96, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 96, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 97, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 97, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 97, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 97, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901800
Epoch 97, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 97, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.902000
Epoch 97, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 97, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.902000
Epoch 97, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 97, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 97, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 97, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902400
Epoch 97, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 97, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 97, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 97, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 97, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 97, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 97, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 97, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 97, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 97, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 97, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.902800
Epoch 97, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 97, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 97, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 97, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 97, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 97, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901600
Epoch 97, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903200
Epoch 97, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 97, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 97, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 97, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 97, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 97, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 97, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 97, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 97, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 97, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902600
Epoch 97, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 97, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 97, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 97, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 97, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 97, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 97, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 97, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 97, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.902000
Epoch 97, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 98, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 98, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 98, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 98, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 98, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 98, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 98, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901800
Epoch 98, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 98, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 98, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902000
Epoch 98, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 98, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 98, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901800
Epoch 98, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 98, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 98, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 98, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 98, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 98, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 98, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 98, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 98, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 98, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903600
Epoch 98, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 98, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 98, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 98, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 98, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 98, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 98, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903200
Epoch 98, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 98, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 98, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 98, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901400
Epoch 98, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902200
Epoch 98, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 98, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 98, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 98, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 98, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902800
Epoch 98, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 98, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 98, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 98, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 98, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903600
Epoch 98, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 98, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 98, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901400
Epoch 98, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 98, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 99, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 99, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 99, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 99, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 99, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 99, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 99, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 99, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 99, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 99, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902000
Epoch 99, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 99, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 99, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 99, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902400
Epoch 99, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 99, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902000
Epoch 99, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 99, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902200
Epoch 99, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901000
Epoch 99, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 99, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 99, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 99, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 99, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 99, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903600
Epoch 99, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 99, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 99, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902400
Epoch 99, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 99, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902600
Epoch 99, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 99, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 99, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 99, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 99, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902200
Epoch 99, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 99, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902800
Epoch 99, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 99, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 99, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 99, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 99, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 99, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 99, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 99, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 99, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902600
Epoch 99, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902600
Epoch 99, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 99, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 99, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 100, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 100, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 100, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 100, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901600
Epoch 100, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 100, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 100, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 100, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 100, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 100, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 100, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 100, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 100, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 100, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903400
Epoch 100, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 100, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 100, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 100, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 100, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 100, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902800
Epoch 100, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 100, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 100, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903600
Epoch 100, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 100, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 100, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903400
Epoch 100, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 100, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 100, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 100, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 100, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 100, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 100, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 100, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 100, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 100, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 100, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 100, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 100, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 100, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 100, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 100, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 100, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.903000
Epoch 100, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 100, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 100, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 100, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 100, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902000
Epoch 100, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901400
Epoch 100, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 101, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 101, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 101, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 101, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 101, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 101, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 101, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 101, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 101, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 101, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902000
Epoch 101, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 101, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 101, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 101, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 101, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903200
Epoch 101, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 101, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 101, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 101, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 101, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902200
Epoch 101, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 101, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 101, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 101, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 101, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 101, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 101, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 101, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 101, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901600
Epoch 101, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 101, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 101, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 101, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 101, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901400
Epoch 101, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901400
Epoch 101, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 101, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 101, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 101, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 101, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 101, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 101, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 101, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 101, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903200
Epoch 101, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 101, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 101, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 101, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 101, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.902200
Epoch 101, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 102, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 102, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 102, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 102, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 102, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 102, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 102, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 102, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 102, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 102, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 102, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902600
Epoch 102, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902600
Epoch 102, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901800
Epoch 102, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 102, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 102, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 102, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 102, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 102, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 102, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 102, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 102, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902200
Epoch 102, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903000
Epoch 102, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 102, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 102, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 102, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 102, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 102, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 102, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902600
Epoch 102, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 102, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 102, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 102, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901400
Epoch 102, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 102, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 102, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 102, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 102, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.901600
Epoch 102, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 102, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901400
Epoch 102, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 102, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 102, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 102, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 102, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 102, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 102, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 102, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 102, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901600
Epoch 103, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 103, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 103, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 103, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 103, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 103, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 103, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 103, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 103, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901200
Epoch 103, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 103, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 103, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 103, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 103, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 103, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 103, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 103, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 103, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 103, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 103, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 103, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 103, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 103, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 103, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 103, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 103, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 103, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 103, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 103, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 103, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 103, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 103, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901600
Epoch 103, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 103, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 103, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901600
Epoch 103, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 103, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902800
Epoch 103, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 103, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 103, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 103, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 103, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 103, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902200
Epoch 103, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 103, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 103, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902800
Epoch 103, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 103, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 103, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901400
Epoch 103, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 104, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 104, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 104, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 104, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 104, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 104, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 104, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 104, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 104, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901200
Epoch 104, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 104, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 104, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902400
Epoch 104, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 104, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902400
Epoch 104, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902000
Epoch 104, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 104, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 104, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 104, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 104, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 104, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 104, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 104, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 104, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 104, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 104, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903400
Epoch 104, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 104, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 104, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 104, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 104, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 104, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902400
Epoch 104, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 104, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902200
Epoch 104, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 104, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 104, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 104, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 104, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 104, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 104, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902200
Epoch 104, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 104, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 104, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 104, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 104, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 104, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 104, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 104, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 104, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 105, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 105, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 105, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 105, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 105, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 105, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901200
Epoch 105, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901000
Epoch 105, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 105, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 105, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 105, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 105, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 105, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 105, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 105, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 105, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 105, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902000
Epoch 105, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 105, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 105, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 105, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 105, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 105, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 105, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.903000
Epoch 105, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903600
Epoch 105, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 105, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 105, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901600
Epoch 105, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902200
Epoch 105, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 105, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 105, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 105, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.901800
Epoch 105, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 105, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901600
Epoch 105, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902200
Epoch 105, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 105, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 105, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 105, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.901800
Epoch 105, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 105, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 105, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 105, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 105, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 105, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902600
Epoch 105, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 105, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 105, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 105, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 106, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 106, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 106, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 106, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901000
Epoch 106, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 106, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 106, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 106, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.902000
Epoch 106, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 106, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 106, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901400
Epoch 106, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 106, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901800
Epoch 106, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 106, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 106, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 106, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 106, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 106, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 106, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902800
Epoch 106, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 106, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 106, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903600
Epoch 106, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 106, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903800
Epoch 106, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 106, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 106, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 106, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901600
Epoch 106, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 106, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 106, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 106, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 106, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 106, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 106, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 106, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 106, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 106, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902600
Epoch 106, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 106, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 106, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 106, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 106, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 106, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 106, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902600
Epoch 106, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 106, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 106, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 106, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 107, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 107, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 107, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 107, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 107, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 107, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 107, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 107, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 107, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901200
Epoch 107, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901200
Epoch 107, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 107, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 107, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 107, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 107, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 107, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 107, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 107, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 107, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 107, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902000
Epoch 107, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 107, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 107, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 107, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 107, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 107, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 107, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 107, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 107, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901400
Epoch 107, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 107, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 107, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 107, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902800
Epoch 107, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902400
Epoch 107, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902200
Epoch 107, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 107, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 107, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 107, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 107, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 107, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901400
Epoch 107, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 107, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 107, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 107, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 107, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902000
Epoch 107, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 107, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902000
Epoch 107, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 107, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 108, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 108, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 108, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 108, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901800
Epoch 108, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 108, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 108, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 108, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 108, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.902000
Epoch 108, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902200
Epoch 108, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901600
Epoch 108, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902600
Epoch 108, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 108, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903400
Epoch 108, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 108, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902800
Epoch 108, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902200
Epoch 108, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 108, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 108, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 108, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 108, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 108, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903000
Epoch 108, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 108, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 108, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 108, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 108, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 108, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 108, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 108, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 108, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 108, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.903000
Epoch 108, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 108, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 108, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 108, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 108, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 108, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 108, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 108, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 108, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 108, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 108, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 108, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 108, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 108, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 108, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 108, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.902000
Epoch 108, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 109, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 109, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 109, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 109, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 109, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 109, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 109, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 109, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 109, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 109, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 109, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 109, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 109, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 109, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 109, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902200
Epoch 109, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 109, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902200
Epoch 109, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902200
Epoch 109, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 109, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 109, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 109, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 109, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 109, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902400
Epoch 109, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.902600
Epoch 109, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 109, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 109, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 109, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 109, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 109, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 109, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 109, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902600
Epoch 109, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902200
Epoch 109, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902200
Epoch 109, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 109, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 109, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 109, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 109, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.901800
Epoch 109, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 109, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 109, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 109, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 109, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 109, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 109, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902600
Epoch 109, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902000
Epoch 109, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 109, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 110, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 110, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 110, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 110, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 110, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 110, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 110, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 110, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 110, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 110, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902000
Epoch 110, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 110, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902600
Epoch 110, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 110, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 110, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 110, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 110, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 110, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 110, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 110, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902800
Epoch 110, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 110, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 110, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 110, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 110, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 110, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 110, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902400
Epoch 110, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 110, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 110, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 110, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902600
Epoch 110, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 110, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 110, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 110, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 110, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 110, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902200
Epoch 110, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 110, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 110, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902600
Epoch 110, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 110, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 110, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 110, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 110, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 110, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 110, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 110, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 110, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 110, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 111, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 111, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 111, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 111, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 111, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 111, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 111, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 111, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 111, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 111, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 111, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 111, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.901800
Epoch 111, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 111, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 111, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 111, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 111, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 111, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902200
Epoch 111, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 111, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 111, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 111, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 111, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903600
Epoch 111, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 111, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 111, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 111, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 111, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 111, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 111, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 111, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 111, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 111, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902600
Epoch 111, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 111, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 111, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 111, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 111, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 111, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 111, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 111, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 111, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 111, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 111, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 111, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 111, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 111, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 111, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 111, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 111, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901600
Epoch 112, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 112, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 112, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 112, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 112, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 112, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 112, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 112, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901200
Epoch 112, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 112, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 112, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902400
Epoch 112, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902800
Epoch 112, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 112, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 112, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 112, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 112, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902200
Epoch 112, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 112, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 112, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.903000
Epoch 112, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902800
Epoch 112, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.903000
Epoch 112, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 112, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 112, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 112, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 112, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 112, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 112, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901600
Epoch 112, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 112, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 112, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 112, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 112, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901400
Epoch 112, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901600
Epoch 112, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 112, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902800
Epoch 112, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.902000
Epoch 112, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 112, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 112, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 112, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 112, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 112, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 112, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 112, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 112, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 112, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 112, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901400
Epoch 112, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 113, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 113, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 113, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 113, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 113, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 113, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 113, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 113, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 113, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 113, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 113, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 113, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 113, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 113, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902600
Epoch 113, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 113, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 113, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.903000
Epoch 113, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 113, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901400
Epoch 113, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 113, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 113, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 113, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 113, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 113, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 113, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 113, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 113, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902400
Epoch 113, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 113, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902400
Epoch 113, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 113, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 113, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 113, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 113, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 113, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 113, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 113, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 113, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 113, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 113, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 113, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 113, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.903000
Epoch 113, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 113, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 113, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902600
Epoch 113, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 113, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 113, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.902000
Epoch 113, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 114, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 114, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 114, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 114, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 114, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 114, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 114, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 114, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 114, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 114, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 114, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 114, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 114, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902400
Epoch 114, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902600
Epoch 114, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 114, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 114, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 114, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 114, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 114, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902200
Epoch 114, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.903200
Epoch 114, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 114, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 114, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 114, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 114, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903600
Epoch 114, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902400
Epoch 114, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 114, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 114, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903200
Epoch 114, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.901800
Epoch 114, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 114, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902600
Epoch 114, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 114, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901600
Epoch 114, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 114, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 114, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 114, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 114, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.901800
Epoch 114, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901400
Epoch 114, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902200
Epoch 114, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 114, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 114, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.902800
Epoch 114, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902000
Epoch 114, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 114, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 114, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 114, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901400
Epoch 115, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 115, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 115, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 115, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 115, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 115, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 115, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901800
Epoch 115, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 115, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 115, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 115, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 115, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.901800
Epoch 115, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 115, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902600
Epoch 115, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902400
Epoch 115, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 115, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 115, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 115, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 115, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 115, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 115, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 115, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 115, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 115, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 115, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 115, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902400
Epoch 115, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 115, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 115, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 115, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902800
Epoch 115, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 115, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 115, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 115, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 115, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 115, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902800
Epoch 115, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 115, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 115, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 115, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 115, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 115, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 115, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902400
Epoch 115, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 115, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 115, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 115, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 115, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 115, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 116, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 116, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 116, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 116, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 116, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 116, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 116, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 116, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 116, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 116, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 116, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901600
Epoch 116, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.901800
Epoch 116, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901800
Epoch 116, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 116, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902400
Epoch 116, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 116, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902200
Epoch 116, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902200
Epoch 116, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901000
Epoch 116, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 116, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 116, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 116, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 116, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 116, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 116, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 116, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 116, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 116, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 116, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 116, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 116, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 116, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 116, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 116, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 116, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 116, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902200
Epoch 116, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.902000
Epoch 116, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 116, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 116, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 116, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 116, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 116, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 116, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 116, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.903000
Epoch 116, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 116, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901400
Epoch 116, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 116, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901400
Epoch 117, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 117, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 117, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902200
Epoch 117, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 117, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 117, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901400
Epoch 117, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 117, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 117, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 117, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 117, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 117, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902400
Epoch 117, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 117, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 117, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 117, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 117, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 117, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 117, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 117, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.903000
Epoch 117, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 117, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 117, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 117, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 117, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 117, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 117, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903200
Epoch 117, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 117, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 117, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 117, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 117, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 117, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.901800
Epoch 117, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 117, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 117, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 117, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 117, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 117, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 117, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 117, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 117, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903200
Epoch 117, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 117, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 117, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 117, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 117, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 117, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902000
Epoch 117, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 117, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 118, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 118, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 118, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 118, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901800
Epoch 118, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 118, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.902000
Epoch 118, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901800
Epoch 118, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901200
Epoch 118, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 118, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 118, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 118, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902600
Epoch 118, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 118, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 118, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903200
Epoch 118, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 118, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 118, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 118, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 118, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902800
Epoch 118, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 118, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 118, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 118, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902400
Epoch 118, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 118, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903400
Epoch 118, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903200
Epoch 118, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902400
Epoch 118, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 118, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 118, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 118, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902400
Epoch 118, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 118, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 118, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 118, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902200
Epoch 118, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902200
Epoch 118, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 118, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 118, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 118, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 118, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 118, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 118, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903200
Epoch 118, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 118, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902600
Epoch 118, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 118, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902000
Epoch 118, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 118, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 119, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 119, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 119, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 119, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 119, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 119, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.902200
Epoch 119, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 119, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 119, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 119, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902000
Epoch 119, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902600
Epoch 119, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 119, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 119, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 119, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902400
Epoch 119, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902000
Epoch 119, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902200
Epoch 119, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 119, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901200
Epoch 119, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 119, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 119, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 119, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 119, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 119, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 119, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 119, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 119, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 119, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 119, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 119, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 119, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902400
Epoch 119, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 119, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 119, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 119, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902000
Epoch 119, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902200
Epoch 119, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 119, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 119, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 119, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 119, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 119, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 119, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 119, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 119, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902000
Epoch 119, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 119, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 119, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 119, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 120, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 120, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 120, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 120, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 120, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 120, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 120, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 120, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 120, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901200
Epoch 120, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 120, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 120, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 120, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901800
Epoch 120, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 120, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 120, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 120, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 120, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 120, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 120, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 120, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 120, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 120, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903600
Epoch 120, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 120, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 120, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 120, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 120, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 120, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 120, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 120, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 120, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 120, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 120, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 120, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902200
Epoch 120, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 120, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 120, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 120, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 120, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 120, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 120, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902200
Epoch 120, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 120, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 120, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 120, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 120, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 120, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902000
Epoch 120, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 120, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 121, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 121, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 121, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 121, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 121, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 121, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901400
Epoch 121, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 121, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 121, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 121, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 121, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 121, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.901800
Epoch 121, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901800
Epoch 121, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 121, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 121, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 121, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.903000
Epoch 121, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 121, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 121, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 121, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 121, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 121, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903000
Epoch 121, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 121, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903600
Epoch 121, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 121, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 121, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 121, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 121, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 121, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 121, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 121, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 121, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 121, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 121, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 121, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 121, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 121, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 121, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 121, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 121, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 121, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 121, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902600
Epoch 121, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 121, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 121, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 121, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 121, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 121, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 122, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 122, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 122, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 122, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 122, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 122, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901200
Epoch 122, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 122, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901000
Epoch 122, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 122, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 122, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 122, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 122, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 122, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 122, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 122, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 122, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 122, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 122, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 122, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 122, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 122, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 122, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 122, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 122, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 122, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903400
Epoch 122, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 122, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 122, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 122, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 122, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 122, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 122, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 122, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 122, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 122, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 122, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 122, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901200
Epoch 122, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 122, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 122, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 122, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 122, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 122, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 122, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 122, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 122, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 122, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901400
Epoch 122, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 122, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 123, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 123, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 123, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 123, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 123, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 123, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901200
Epoch 123, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901800
Epoch 123, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 123, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 123, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 123, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902400
Epoch 123, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902600
Epoch 123, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 123, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903200
Epoch 123, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 123, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902600
Epoch 123, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 123, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 123, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 123, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902000
Epoch 123, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 123, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 123, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903600
Epoch 123, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 123, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 123, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 123, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 123, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902400
Epoch 123, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 123, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902400
Epoch 123, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 123, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 123, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.901800
Epoch 123, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901400
Epoch 123, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 123, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 123, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902200
Epoch 123, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 123, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 123, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 123, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 123, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 123, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 123, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 123, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 123, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902600
Epoch 123, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902600
Epoch 123, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 123, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 123, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 124, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 124, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901600
Epoch 124, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 124, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901600
Epoch 124, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 124, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901200
Epoch 124, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901200
Epoch 124, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901200
Epoch 124, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 124, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 124, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 124, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 124, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902400
Epoch 124, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 124, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 124, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902600
Epoch 124, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 124, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 124, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 124, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.903000
Epoch 124, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 124, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 124, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 124, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.903000
Epoch 124, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 124, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 124, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 124, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 124, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 124, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 124, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 124, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 124, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 124, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 124, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901600
Epoch 124, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902800
Epoch 124, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 124, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 124, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 124, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 124, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 124, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 124, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 124, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 124, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 124, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 124, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 124, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902000
Epoch 124, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 124, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 125, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 125, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 125, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 125, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 125, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 125, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901200
Epoch 125, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901200
Epoch 125, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 125, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 125, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 125, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 125, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902800
Epoch 125, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 125, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 125, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 125, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902600
Epoch 125, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.903000
Epoch 125, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 125, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902200
Epoch 125, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 125, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 125, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 125, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903000
Epoch 125, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 125, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 125, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903400
Epoch 125, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 125, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 125, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 125, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903400
Epoch 125, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 125, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901600
Epoch 125, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902600
Epoch 125, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 125, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 125, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 125, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902200
Epoch 125, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 125, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 125, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 125, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 125, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 125, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 125, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 125, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 125, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 125, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 125, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 125, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 125, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 126, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 126, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 126, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 126, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 126, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 126, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 126, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 126, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 126, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 126, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902000
Epoch 126, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 126, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 126, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902600
Epoch 126, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 126, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 126, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902600
Epoch 126, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902200
Epoch 126, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 126, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 126, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 126, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902800
Epoch 126, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.903000
Epoch 126, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903600
Epoch 126, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 126, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 126, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903400
Epoch 126, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 126, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 126, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 126, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 126, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902600
Epoch 126, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 126, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 126, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901400
Epoch 126, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 126, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 126, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 126, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 126, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 126, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 126, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 126, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 126, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 126, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 126, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 126, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902600
Epoch 126, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 126, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 126, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 126, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 127, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 127, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901800
Epoch 127, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 127, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901600
Epoch 127, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 127, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 127, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 127, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 127, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 127, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 127, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 127, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 127, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 127, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 127, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 127, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 127, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 127, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 127, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 127, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 127, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 127, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 127, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 127, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 127, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 127, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 127, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 127, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 127, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 127, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 127, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 127, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901600
Epoch 127, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 127, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902200
Epoch 127, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902200
Epoch 127, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 127, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 127, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 127, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 127, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 127, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 127, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 127, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 127, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 127, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 127, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902000
Epoch 127, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 127, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 127, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 127, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 128, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 128, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 128, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 128, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 128, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902600
Epoch 128, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 128, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902400
Epoch 128, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903200
Epoch 128, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 128, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 128, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.903200
Epoch 128, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 128, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 128, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 128, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 128, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 128, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903600
Epoch 128, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 128, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 128, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 128, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 128, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902200
Epoch 128, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902200
Epoch 128, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 128, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 128, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 128, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 128, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 128, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 128, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 128, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 128, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.902800
Epoch 128, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 128, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 128, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 128, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 128, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 129, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 129, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901800
Epoch 129, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.901800
Epoch 129, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 129, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901400
Epoch 129, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 129, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 129, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 129, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 129, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 129, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 129, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902400
Epoch 129, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901800
Epoch 129, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903200
Epoch 129, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 129, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 129, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 129, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 129, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 129, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902200
Epoch 129, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 129, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 129, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 129, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 129, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 129, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903600
Epoch 129, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 129, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 129, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 129, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 129, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 129, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 129, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 129, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 129, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901400
Epoch 129, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 129, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 129, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 129, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 129, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 129, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 129, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 129, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 129, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902600
Epoch 129, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 129, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902600
Epoch 129, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 129, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901400
Epoch 129, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 129, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 130, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 130, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 130, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 130, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 130, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 130, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.902000
Epoch 130, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 130, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.902000
Epoch 130, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 130, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902000
Epoch 130, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 130, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 130, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 130, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 130, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 130, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 130, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 130, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902200
Epoch 130, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 130, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902200
Epoch 130, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 130, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 130, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 130, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902400
Epoch 130, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 130, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 130, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 130, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 130, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 130, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 130, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 130, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 130, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 130, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 130, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901600
Epoch 130, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 130, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 130, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 130, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 130, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 130, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 130, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 130, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 130, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 130, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 130, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902000
Epoch 130, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 130, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901200
Epoch 130, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 130, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 131, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 131, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 131, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 131, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 131, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 131, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.902000
Epoch 131, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 131, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901200
Epoch 131, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 131, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 131, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901600
Epoch 131, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 131, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901800
Epoch 131, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 131, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903200
Epoch 131, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 131, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.903000
Epoch 131, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 131, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 131, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902200
Epoch 131, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 131, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 131, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 131, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 131, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 131, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 131, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 131, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 131, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 131, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 131, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 131, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 131, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902800
Epoch 131, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 131, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 131, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902200
Epoch 131, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 131, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 131, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 131, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 131, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 131, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902400
Epoch 131, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.903000
Epoch 131, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903400
Epoch 131, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.902800
Epoch 131, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 131, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 131, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 131, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.902000
Epoch 131, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 132, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901400
Epoch 132, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 132, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 132, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901600
Epoch 132, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 132, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 132, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 132, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 132, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 132, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 132, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 132, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902400
Epoch 132, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 132, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903200
Epoch 132, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 132, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 132, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 132, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 132, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 132, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 132, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 132, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 132, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903000
Epoch 132, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 132, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 132, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903600
Epoch 132, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 132, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 132, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 132, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902600
Epoch 132, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.901800
Epoch 132, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 132, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 132, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901200
Epoch 132, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901200
Epoch 132, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 132, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902200
Epoch 132, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 132, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 132, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 132, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 132, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 132, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 132, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 132, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.902800
Epoch 132, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 132, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 132, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 132, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 132, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 133, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 133, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 133, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 133, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 133, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 133, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 133, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 133, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 133, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 133, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 133, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901600
Epoch 133, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.901800
Epoch 133, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 133, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903200
Epoch 133, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902400
Epoch 133, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 133, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 133, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 133, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 133, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 133, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 133, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 133, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 133, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 133, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903600
Epoch 133, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 133, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 133, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 133, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901600
Epoch 133, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 133, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 133, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 133, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 133, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902200
Epoch 133, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 133, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 133, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 133, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901200
Epoch 133, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 133, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 133, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 133, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 133, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 133, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903200
Epoch 133, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 133, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 133, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 133, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 133, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901400
Epoch 133, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 134, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 134, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 134, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 134, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 134, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 134, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 134, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901800
Epoch 134, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 134, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 134, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902000
Epoch 134, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 134, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 134, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901800
Epoch 134, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 134, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902200
Epoch 134, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 134, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 134, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 134, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 134, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 134, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 134, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 134, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 134, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 134, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 134, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903400
Epoch 134, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 134, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 134, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 134, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 134, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 134, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902400
Epoch 134, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 134, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 134, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902200
Epoch 134, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902200
Epoch 134, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 134, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 134, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 134, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902800
Epoch 134, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901400
Epoch 134, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 134, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902200
Epoch 134, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 134, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 134, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902600
Epoch 134, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 134, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 134, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 134, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 135, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 135, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 135, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 135, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 135, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 135, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.902000
Epoch 135, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901200
Epoch 135, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 135, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 135, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 135, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 135, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902400
Epoch 135, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 135, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 135, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902400
Epoch 135, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 135, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 135, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 135, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 135, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902200
Epoch 135, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 135, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 135, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 135, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 135, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 135, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 135, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 135, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 135, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901600
Epoch 135, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 135, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 135, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 135, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902800
Epoch 135, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 135, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 135, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 135, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 135, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 135, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 135, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 135, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 135, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 135, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 135, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 135, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 135, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.901800
Epoch 135, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902600
Epoch 135, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901400
Epoch 135, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.902000
Epoch 135, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 136, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 136, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 136, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 136, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 136, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 136, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901400
Epoch 136, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 136, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 136, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901200
Epoch 136, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 136, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901600
Epoch 136, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 136, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 136, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903400
Epoch 136, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903200
Epoch 136, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902800
Epoch 136, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 136, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 136, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 136, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 136, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 136, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 136, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 136, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 136, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 136, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 136, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 136, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 136, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 136, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 136, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 136, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 136, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 136, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901400
Epoch 136, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 136, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 136, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 136, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 136, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 136, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 136, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 136, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 136, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 136, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 136, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 136, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902800
Epoch 136, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 136, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 136, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 136, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 137, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 137, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 137, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 137, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 137, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 137, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 137, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 137, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901200
Epoch 137, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901200
Epoch 137, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901200
Epoch 137, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 137, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 137, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 137, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902400
Epoch 137, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902200
Epoch 137, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 137, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.903000
Epoch 137, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902200
Epoch 137, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901400
Epoch 137, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902800
Epoch 137, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902800
Epoch 137, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 137, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903600
Epoch 137, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 137, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.902600
Epoch 137, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 137, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 137, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 137, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 137, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903200
Epoch 137, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 137, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 137, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902600
Epoch 137, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 137, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 137, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 137, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902800
Epoch 137, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 137, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 137, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.901800
Epoch 137, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 137, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 137, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 137, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 137, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 137, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 137, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 137, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 137, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 137, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 138, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 138, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 138, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 138, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 138, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 138, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 138, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 138, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 138, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 138, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 138, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 138, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 138, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 138, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903400
Epoch 138, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 138, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 138, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 138, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 138, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 138, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 138, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 138, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 138, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 138, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 138, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 138, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903400
Epoch 138, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902400
Epoch 138, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 138, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 138, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 138, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.903000
Epoch 138, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 138, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 138, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 138, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 138, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 138, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 138, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 138, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 138, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 138, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902200
Epoch 138, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 138, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902000
Epoch 138, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 138, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 138, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 138, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 138, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 138, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 138, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 139, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 139, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 139, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 139, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901600
Epoch 139, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 139, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 139, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 139, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 139, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 139, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 139, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 139, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902600
Epoch 139, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 139, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 139, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 139, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902600
Epoch 139, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 139, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 139, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 139, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902000
Epoch 139, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.903000
Epoch 139, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902200
Epoch 139, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 139, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 139, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 139, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 139, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 139, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 139, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901400
Epoch 139, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 139, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 139, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 139, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 139, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 139, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 139, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 139, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 139, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 139, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 139, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 139, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 139, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 139, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 139, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 139, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 139, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902800
Epoch 139, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 139, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 139, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 139, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901600
Epoch 140, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 140, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 140, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.901800
Epoch 140, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901000
Epoch 140, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 140, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 140, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 140, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901200
Epoch 140, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 140, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902000
Epoch 140, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 140, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 140, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 140, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903200
Epoch 140, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 140, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 140, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.903000
Epoch 140, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 140, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 140, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 140, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 140, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902200
Epoch 140, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903000
Epoch 140, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 140, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.902800
Epoch 140, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 140, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 140, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 140, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901600
Epoch 140, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903200
Epoch 140, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 140, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 140, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 140, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902200
Epoch 140, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 140, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902800
Epoch 140, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 140, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 140, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 140, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 140, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902200
Epoch 140, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 140, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 140, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902600
Epoch 140, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 140, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 140, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 140, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 140, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 140, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 141, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 141, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 141, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 141, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901600
Epoch 141, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 141, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 141, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 141, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901200
Epoch 141, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 141, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 141, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 141, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 141, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 141, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 141, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 141, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 141, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 141, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902200
Epoch 141, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 141, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 141, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 141, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902200
Epoch 141, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 141, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 141, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 141, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 141, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 141, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901600
Epoch 141, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 141, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903200
Epoch 141, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 141, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902400
Epoch 141, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 141, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901400
Epoch 141, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 141, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 141, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 141, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 141, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 141, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 141, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 141, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 141, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 141, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 141, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.902800
Epoch 141, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 141, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 141, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 141, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 141, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901600
Epoch 142, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 142, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 142, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 142, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 142, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 142, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901200
Epoch 142, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 142, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 142, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 142, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 142, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 142, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902400
Epoch 142, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 142, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903200
Epoch 142, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 142, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902000
Epoch 142, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 142, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 142, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 142, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902200
Epoch 142, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 142, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 142, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 142, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 142, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 142, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 142, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 142, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 142, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 142, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 142, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 142, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901600
Epoch 142, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902600
Epoch 142, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902200
Epoch 142, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 142, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902000
Epoch 142, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 142, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 142, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 142, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 142, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 142, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 142, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 142, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 142, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 142, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902600
Epoch 142, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 142, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 142, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 142, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 143, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 143, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 143, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 143, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 143, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 143, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 143, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 143, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901200
Epoch 143, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 143, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902000
Epoch 143, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 143, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 143, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 143, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 143, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 143, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 143, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 143, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902200
Epoch 143, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901400
Epoch 143, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902200
Epoch 143, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 143, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 143, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 143, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 143, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 143, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 143, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 143, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902400
Epoch 143, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 143, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 143, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 143, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 143, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902600
Epoch 143, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 143, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 143, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902200
Epoch 143, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 143, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 143, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 143, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902600
Epoch 143, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 143, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 143, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 143, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 143, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 143, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 143, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 143, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 143, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 143, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 144, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 144, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901600
Epoch 144, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 144, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 144, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 144, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 144, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 144, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 144, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 144, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 144, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 144, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902800
Epoch 144, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 144, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903400
Epoch 144, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 144, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 144, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902200
Epoch 144, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 144, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 144, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 144, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 144, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 144, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 144, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 144, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 144, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903400
Epoch 144, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 144, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 144, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902200
Epoch 144, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902600
Epoch 144, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 144, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 144, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902800
Epoch 144, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902200
Epoch 144, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901600
Epoch 144, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 144, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 144, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 144, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 144, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 144, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 144, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 144, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.903000
Epoch 144, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 144, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 144, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 144, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 144, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 144, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 144, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 145, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 145, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 145, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 145, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 145, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 145, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 145, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 145, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 145, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 145, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 145, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 145, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 145, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 145, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903200
Epoch 145, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 145, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 145, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 145, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 145, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 145, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 145, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 145, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 145, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 145, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 145, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 145, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 145, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 145, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 145, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 145, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 145, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 145, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 145, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 145, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902400
Epoch 145, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 145, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 145, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 145, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 145, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 145, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902600
Epoch 145, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901400
Epoch 145, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 145, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 145, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903200
Epoch 145, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 145, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902000
Epoch 145, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 145, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902200
Epoch 145, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 145, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901600
Epoch 146, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 146, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901600
Epoch 146, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 146, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 146, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 146, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 146, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 146, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 146, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 146, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 146, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 146, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.901800
Epoch 146, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 146, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 146, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 146, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 146, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 146, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 146, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 146, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 146, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 146, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 146, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 146, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 146, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 146, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 146, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 146, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 146, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 146, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 146, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.901800
Epoch 146, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 146, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902600
Epoch 146, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 146, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902200
Epoch 146, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 146, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 146, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 146, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 146, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 146, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 146, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 146, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 146, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 146, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 146, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902600
Epoch 146, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902600
Epoch 146, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 146, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 146, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 147, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 147, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 147, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 147, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901600
Epoch 147, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 147, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 147, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.902000
Epoch 147, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 147, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901200
Epoch 147, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901200
Epoch 147, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 147, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 147, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901600
Epoch 147, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902600
Epoch 147, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902400
Epoch 147, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902600
Epoch 147, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 147, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 147, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 147, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 147, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902800
Epoch 147, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 147, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 147, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 147, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 147, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 147, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 147, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 147, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 147, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 147, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 147, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901600
Epoch 147, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 147, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 147, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 147, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 147, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902200
Epoch 147, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 147, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 147, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 147, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902200
Epoch 147, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 147, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 147, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903400
Epoch 147, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 147, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902800
Epoch 147, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 147, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 147, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 147, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901600
Epoch 148, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 148, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901600
Epoch 148, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 148, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 148, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 148, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 148, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 148, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901000
Epoch 148, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 148, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 148, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 148, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 148, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 148, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 148, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902000
Epoch 148, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 148, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 148, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 148, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 148, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 148, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 148, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 148, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903600
Epoch 148, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 148, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.902800
Epoch 148, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 148, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902200
Epoch 148, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 148, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901600
Epoch 148, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 148, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 148, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 148, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 148, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901400
Epoch 148, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 148, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 148, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 148, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 148, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 148, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 148, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 148, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 148, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 148, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902600
Epoch 148, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 148, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 148, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 148, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 148, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 148, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901600
Epoch 149, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 149, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 149, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 149, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 149, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 149, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901200
Epoch 149, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901200
Epoch 149, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901200
Epoch 149, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 149, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 149, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 149, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902400
Epoch 149, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 149, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 149, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 149, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 149, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 149, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 149, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 149, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 149, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 149, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 149, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903600
Epoch 149, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 149, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 149, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 149, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 149, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 149, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 149, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 149, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 149, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 149, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 149, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902200
Epoch 149, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 149, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 149, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 149, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 149, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 149, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 149, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 149, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 149, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.903000
Epoch 149, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 149, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 149, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902600
Epoch 149, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 149, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901400
Epoch 149, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 149, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 150, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 150, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 150, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 150, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 150, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 150, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.902000
Epoch 150, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901800
Epoch 150, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 150, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 150, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902000
Epoch 150, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 150, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902400
Epoch 150, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901600
Epoch 150, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902400
Epoch 150, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903200
Epoch 150, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 150, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 150, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 150, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 150, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 150, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 150, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 150, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903600
Epoch 150, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 150, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 150, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 150, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 150, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902400
Epoch 150, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 150, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 150, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 150, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 150, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.903000
Epoch 150, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901400
Epoch 150, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901600
Epoch 150, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 150, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902200
Epoch 150, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 150, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 150, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 150, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 150, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 150, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 150, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903200
Epoch 150, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 150, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902000
Epoch 150, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902600
Epoch 150, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902400
Epoch 150, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 150, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 151, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 151, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901600
Epoch 151, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 151, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901600
Epoch 151, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 151, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901400
Epoch 151, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901000
Epoch 151, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901200
Epoch 151, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 151, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 151, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901600
Epoch 151, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902400
Epoch 151, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 151, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902600
Epoch 151, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902400
Epoch 151, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 151, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 151, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 151, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 151, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 151, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 151, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 151, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 151, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 151, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 151, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 151, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 151, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 151, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902400
Epoch 151, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903200
Epoch 151, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 151, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 151, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 151, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902200
Epoch 151, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 151, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902200
Epoch 151, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 151, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 151, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 151, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.903000
Epoch 151, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 151, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 151, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 151, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902600
Epoch 151, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 151, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 151, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 151, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 151, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 151, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901600
Epoch 152, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901600
Epoch 152, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901600
Epoch 152, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 152, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 152, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901400
Epoch 152, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 152, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 152, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 152, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 152, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 152, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 152, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902600
Epoch 152, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901800
Epoch 152, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902600
Epoch 152, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902400
Epoch 152, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 152, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.903000
Epoch 152, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902800
Epoch 152, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 152, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 152, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902800
Epoch 152, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 152, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 152, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902400
Epoch 152, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 152, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 152, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 152, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901400
Epoch 152, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902200
Epoch 152, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 152, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 152, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 152, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902000
Epoch 152, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 152, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 152, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 152, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 152, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 152, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 152, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902600
Epoch 152, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 152, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.903000
Epoch 152, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 152, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 152, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 152, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 152, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902600
Epoch 152, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 152, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 152, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 153, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 153, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 153, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 153, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901600
Epoch 153, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 153, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 153, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 153, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 153, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901800
Epoch 153, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 153, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 153, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 153, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901400
Epoch 153, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 153, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 153, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 153, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 153, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 153, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 153, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 153, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 153, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 153, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903000
Epoch 153, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 153, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 153, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 153, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 153, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 153, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902200
Epoch 153, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 153, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.901800
Epoch 153, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901600
Epoch 153, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 153, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902200
Epoch 153, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 153, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 153, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 153, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.902000
Epoch 153, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 153, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.901600
Epoch 153, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 153, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 153, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902400
Epoch 153, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902600
Epoch 153, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 153, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902800
Epoch 153, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 153, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 153, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 153, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 154, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 154, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 154, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 154, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 154, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 154, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 154, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901200
Epoch 154, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 154, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 154, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.902200
Epoch 154, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 154, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 154, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 154, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903400
Epoch 154, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 154, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 154, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 154, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902200
Epoch 154, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 154, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 154, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902800
Epoch 154, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 154, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 154, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 154, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 154, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 154, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 154, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 154, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901600
Epoch 154, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 154, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 154, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902400
Epoch 154, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902800
Epoch 154, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901400
Epoch 154, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 154, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 154, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902800
Epoch 154, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 154, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 154, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 154, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 154, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 154, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.903000
Epoch 154, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903200
Epoch 154, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 154, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902000
Epoch 154, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902600
Epoch 154, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 154, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 154, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 155, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901400
Epoch 155, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 155, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.901800
Epoch 155, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 155, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 155, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 155, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 155, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901200
Epoch 155, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 155, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 155, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 155, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 155, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 155, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 155, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902200
Epoch 155, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 155, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 155, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 155, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 155, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 155, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 155, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 155, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 155, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 155, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 155, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 155, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 155, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 155, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 155, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902800
Epoch 155, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 155, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 155, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.901800
Epoch 155, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 155, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 155, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902200
Epoch 155, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 155, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 155, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 155, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 155, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 155, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 155, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 155, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 155, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 155, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 155, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902600
Epoch 155, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902000
Epoch 155, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901400
Epoch 155, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 156, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 156, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 156, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 156, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901800
Epoch 156, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 156, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 156, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901400
Epoch 156, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 156, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.902000
Epoch 156, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 156, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901600
Epoch 156, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 156, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 156, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902600
Epoch 156, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.903000
Epoch 156, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 156, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 156, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 156, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 156, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902200
Epoch 156, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 156, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902800
Epoch 156, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 156, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 156, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 156, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 156, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 156, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 156, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 156, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903200
Epoch 156, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 156, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 156, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 156, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 156, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 156, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 156, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 156, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 156, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 156, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 156, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 156, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 156, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 156, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 156, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 156, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902000
Epoch 156, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 156, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901600
Epoch 156, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 156, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901800
Epoch 157, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 157, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 157, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 157, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 157, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901200
Epoch 157, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 157, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 157, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.902000
Epoch 157, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.902000
Epoch 157, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 157, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 157, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902600
Epoch 157, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 157, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 157, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 157, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 157, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 157, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 157, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901800
Epoch 157, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 157, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 157, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902200
Epoch 157, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 157, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 157, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903200
Epoch 157, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 157, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 157, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902400
Epoch 157, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902400
Epoch 157, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 157, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 157, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 157, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 157, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 157, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 157, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902000
Epoch 157, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 157, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 157, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 157, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 157, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902200
Epoch 157, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 157, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 157, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 157, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.902600
Epoch 157, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902000
Epoch 157, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 157, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 157, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 157, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 158, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 158, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 158, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.901800
Epoch 158, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 158, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901400
Epoch 158, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 158, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901000
Epoch 158, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 158, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 158, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 158, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901600
Epoch 158, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 158, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.901800
Epoch 158, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 158, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902200
Epoch 158, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 158, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 158, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 158, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902200
Epoch 158, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902800
Epoch 158, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 158, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 158, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 158, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 158, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903000
Epoch 158, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903400
Epoch 158, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 158, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 158, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 158, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902600
Epoch 158, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 158, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 158, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 158, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901600
Epoch 158, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 158, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 158, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902400
Epoch 158, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 158, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 158, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902000
Epoch 158, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 158, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902400
Epoch 158, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 158, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902600
Epoch 158, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 158, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 158, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 158, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902000
Epoch 158, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.902000
Epoch 158, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 159, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 159, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 159, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.901800
Epoch 159, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 159, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 159, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 159, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 159, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901800
Epoch 159, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901400
Epoch 159, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 159, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 159, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 159, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902000
Epoch 159, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 159, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 159, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 159, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902200
Epoch 159, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 159, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 159, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902000
Epoch 159, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 159, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 159, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 159, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 159, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903600
Epoch 159, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 159, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 159, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 159, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 159, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.902600
Epoch 159, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 159, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 159, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 159, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 159, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902200
Epoch 159, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 159, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 159, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 159, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.901800
Epoch 159, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902600
Epoch 159, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901600
Epoch 159, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 159, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 159, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902600
Epoch 159, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903200
Epoch 159, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 159, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902200
Epoch 159, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 159, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 159, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902200
Epoch 160, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 160, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901200
Epoch 160, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 160, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 160, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 160, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901600
Epoch 160, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 160, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 160, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 160, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 160, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901600
Epoch 160, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 160, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 160, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902600
Epoch 160, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902400
Epoch 160, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 160, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902400
Epoch 160, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 160, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 160, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902200
Epoch 160, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 160, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902400
Epoch 160, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 160, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 160, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 160, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 160, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902400
Epoch 160, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 160, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 160, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 160, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 160, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.901800
Epoch 160, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 160, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 160, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 160, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902600
Epoch 160, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 160, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 160, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902600
Epoch 160, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902400
Epoch 160, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 160, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902600
Epoch 160, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.903000
Epoch 160, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 160, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.902800
Epoch 160, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 160, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 160, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902000
Epoch 160, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 160, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902400
Epoch 161, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 161, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 161, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 161, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901600
Epoch 161, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.902000
Epoch 161, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901400
Epoch 161, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901200
Epoch 161, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 161, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901200
Epoch 161, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901400
Epoch 161, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.901800
Epoch 161, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902000
Epoch 161, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 161, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903200
Epoch 161, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902400
Epoch 161, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 161, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.903000
Epoch 161, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 161, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902200
Epoch 161, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 161, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 161, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 161, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.902800
Epoch 161, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 161, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903600
Epoch 161, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 161, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 161, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902200
Epoch 161, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901600
Epoch 161, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 161, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902400
Epoch 161, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 161, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 161, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901200
Epoch 161, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 161, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 161, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902200
Epoch 161, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 161, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902400
Epoch 161, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 161, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902200
Epoch 161, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 161, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 161, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 161, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 161, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902200
Epoch 161, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 161, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902000
Epoch 161, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901800
Epoch 161, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901600
Epoch 162, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 162, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 162, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 162, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901200
Epoch 162, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901800
Epoch 162, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901400
Epoch 162, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 162, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901600
Epoch 162, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 162, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901600
Epoch 162, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902400
Epoch 162, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902600
Epoch 162, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902400
Epoch 162, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.903000
Epoch 162, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 162, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.901800
Epoch 162, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902800
Epoch 162, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 162, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 162, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902400
Epoch 162, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902400
Epoch 162, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 162, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903400
Epoch 162, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902800
Epoch 162, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 162, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 162, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902600
Epoch 162, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 162, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902200
Epoch 162, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903200
Epoch 162, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 162, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902200
Epoch 162, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902400
Epoch 162, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.901800
Epoch 162, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 162, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902800
Epoch 162, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 162, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901800
Epoch 162, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 162, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.901800
Epoch 162, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 162, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 162, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 162, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.902800
Epoch 162, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903400
Epoch 162, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902400
Epoch 162, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 162, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901400
Epoch 162, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 162, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901400
Epoch 163, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.902000
Epoch 163, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 163, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 163, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901800
Epoch 163, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901600
Epoch 163, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 163, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 163, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901000
Epoch 163, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901600
Epoch 163, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 163, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902200
Epoch 163, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.902200
Epoch 163, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902400
Epoch 163, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 163, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902800
Epoch 163, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902400
Epoch 163, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.903000
Epoch 163, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902400
Epoch 163, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.901600
Epoch 163, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902000
Epoch 163, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 163, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 163, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903200
Epoch 163, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 163, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903600
Epoch 163, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903200
Epoch 163, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.903000
Epoch 163, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.902000
Epoch 163, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.902000
Epoch 163, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903400
Epoch 163, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902200
Epoch 163, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 163, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.902200
Epoch 163, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902200
Epoch 163, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.902000
Epoch 163, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 163, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 163, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901400
Epoch 163, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902200
Epoch 163, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902600
Epoch 163, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.902000
Epoch 163, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 163, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902800
Epoch 163, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903200
Epoch 163, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.902800
Epoch 163, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902000
Epoch 163, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 163, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.902200
Epoch 163, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 163, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.902000
Epoch 164, CIFAR-10 Batch 1:  Loss:     0.1308 Validation Accuracy: 0.901800
Epoch 164, CIFAR-10 Batch 2:  Loss:     0.1382 Validation Accuracy: 0.901400
Epoch 164, CIFAR-10 Batch 3:  Loss:     0.1199 Validation Accuracy: 0.902000
Epoch 164, CIFAR-10 Batch 4:  Loss:     0.1313 Validation Accuracy: 0.901400
Epoch 164, CIFAR-10 Batch 5:  Loss:     0.1689 Validation Accuracy: 0.901400
Epoch 164, CIFAR-10 Batch 6:  Loss:     0.2171 Validation Accuracy: 0.901800
Epoch 164, CIFAR-10 Batch 7:  Loss:     0.1832 Validation Accuracy: 0.901600
Epoch 164, CIFAR-10 Batch 8:  Loss:     0.2928 Validation Accuracy: 0.901400
Epoch 164, CIFAR-10 Batch 9:  Loss:     0.1792 Validation Accuracy: 0.901200
Epoch 164, CIFAR-10 Batch 10:  Loss:     0.1262 Validation Accuracy: 0.901800
Epoch 164, CIFAR-10 Batch 11:  Loss:     0.1335 Validation Accuracy: 0.902000
Epoch 164, CIFAR-10 Batch 12:  Loss:     0.1331 Validation Accuracy: 0.901800
Epoch 164, CIFAR-10 Batch 13:  Loss:     0.1466 Validation Accuracy: 0.902200
Epoch 164, CIFAR-10 Batch 14:  Loss:     0.1396 Validation Accuracy: 0.902800
Epoch 164, CIFAR-10 Batch 15:  Loss:     0.1269 Validation Accuracy: 0.902600
Epoch 164, CIFAR-10 Batch 16:  Loss:     0.1536 Validation Accuracy: 0.902200
Epoch 164, CIFAR-10 Batch 17:  Loss:     0.1910 Validation Accuracy: 0.902600
Epoch 164, CIFAR-10 Batch 18:  Loss:     0.1308 Validation Accuracy: 0.902600
Epoch 164, CIFAR-10 Batch 19:  Loss:     0.1365 Validation Accuracy: 0.902000
Epoch 164, CIFAR-10 Batch 20:  Loss:     0.1539 Validation Accuracy: 0.902600
Epoch 164, CIFAR-10 Batch 21:  Loss:     0.1322 Validation Accuracy: 0.902600
Epoch 164, CIFAR-10 Batch 22:  Loss:     0.1501 Validation Accuracy: 0.902600
Epoch 164, CIFAR-10 Batch 23:  Loss:     0.1272 Validation Accuracy: 0.903000
Epoch 164, CIFAR-10 Batch 24:  Loss:     0.1349 Validation Accuracy: 0.902600
Epoch 164, CIFAR-10 Batch 25:  Loss:     0.1537 Validation Accuracy: 0.903400
Epoch 164, CIFAR-10 Batch 26:  Loss:     0.1308 Validation Accuracy: 0.903000
Epoch 164, CIFAR-10 Batch 27:  Loss:     0.1162 Validation Accuracy: 0.902800
Epoch 164, CIFAR-10 Batch 28:  Loss:     0.1921 Validation Accuracy: 0.901800
Epoch 164, CIFAR-10 Batch 29:  Loss:     0.1496 Validation Accuracy: 0.901800
Epoch 164, CIFAR-10 Batch 30:  Loss:     0.1353 Validation Accuracy: 0.903000
Epoch 164, CIFAR-10 Batch 31:  Loss:     0.1316 Validation Accuracy: 0.902000
Epoch 164, CIFAR-10 Batch 32:  Loss:     0.1340 Validation Accuracy: 0.902000
Epoch 164, CIFAR-10 Batch 33:  Loss:     0.1608 Validation Accuracy: 0.901800
Epoch 164, CIFAR-10 Batch 34:  Loss:     0.1592 Validation Accuracy: 0.902000
Epoch 164, CIFAR-10 Batch 35:  Loss:     0.1591 Validation Accuracy: 0.901800
Epoch 164, CIFAR-10 Batch 36:  Loss:     0.1937 Validation Accuracy: 0.902400
Epoch 164, CIFAR-10 Batch 37:  Loss:     0.1431 Validation Accuracy: 0.902600
Epoch 164, CIFAR-10 Batch 38:  Loss:     0.1179 Validation Accuracy: 0.901600
Epoch 164, CIFAR-10 Batch 39:  Loss:     0.1223 Validation Accuracy: 0.902000
Epoch 164, CIFAR-10 Batch 40:  Loss:     0.1517 Validation Accuracy: 0.902200
Epoch 164, CIFAR-10 Batch 41:  Loss:     0.1250 Validation Accuracy: 0.901800
Epoch 164, CIFAR-10 Batch 42:  Loss:     0.1385 Validation Accuracy: 0.902800
Epoch 164, CIFAR-10 Batch 43:  Loss:     0.1432 Validation Accuracy: 0.902600
Epoch 164, CIFAR-10 Batch 44:  Loss:     0.1218 Validation Accuracy: 0.903000
Epoch 164, CIFAR-10 Batch 45:  Loss:     0.1171 Validation Accuracy: 0.903000
Epoch 164, CIFAR-10 Batch 46:  Loss:     0.1214 Validation Accuracy: 0.902000
Epoch 164, CIFAR-10 Batch 47:  Loss:     0.1311 Validation Accuracy: 0.902400
Epoch 164, CIFAR-10 Batch 48:  Loss:     0.1283 Validation Accuracy: 0.901800
Epoch 164, CIFAR-10 Batch 49:  Loss:     0.1550 Validation Accuracy: 0.901600
Epoch 164, CIFAR-10 Batch 50:  Loss:     0.1348 Validation Accuracy: 0.901600

Checkpoint

The model has been saved to disk.

Test Model

Test your model against the test dataset. This will be your final accuracy. You should have an accuracy greater than 50%. If you don't, keep tweaking the model architecture and parameters.

In [72]:
%matplotlib inline
%config InlineBackend.figure_format = 'retina'

import tensorflow as tf
import pickle
import random

# Set batch size if not already set

try:
    if batch_size:
        pass
except NameError:
    batch_size = 64

save_model_path = './image_classification'
n_samples = 4
top_n_predictions = 3

def test_model():
    """
    Test the saved model against the test dataset
    """

    test_features, test_labels = pickle.load(open('preprocess_test.p', mode='rb'))
    loaded_graph = tf.Graph()

    with tf.Session(graph=loaded_graph) as sess:
        # Load model
        loader = tf.train.import_meta_graph(save_model_path + '.meta')
        loader.restore(sess, save_model_path)

        # Get Tensors from loaded model
        loaded_x = loaded_graph.get_tensor_by_name('inputs/x:0')
        loaded_y = loaded_graph.get_tensor_by_name('inputs/y:0')
        loaded_keep_prob_1 = loaded_graph.get_tensor_by_name('inputs/keep_prob_1:0')
        loaded_keep_prob_2 = loaded_graph.get_tensor_by_name('inputs/keep_prob_2:0')
        loaded_logits = loaded_graph.get_tensor_by_name('logits/logits:0')
        loaded_acc = loaded_graph.get_tensor_by_name('predictions/accuracy:0')
        loaded_is_training = loaded_graph.get_tensor_by_name('inputs/is_training:0')
        
        # Get accuracy in batches for memory limitations
        test_batch_acc_total = 0
        test_batch_count = 0
        
        for test_feature_batch, test_label_batch in batch_features_labels(test_features, test_labels, batch_size):
            test_batch_acc_total += sess.run(
                loaded_acc,
                feed_dict={loaded_x: test_feature_batch, loaded_y: test_label_batch, loaded_keep_prob_1: 1.0, loaded_keep_prob_2: 1.0,
                           loaded_is_training:False})
            test_batch_count += 1

        print('Testing Accuracy: {}\n'.format(test_batch_acc_total/test_batch_count))

        # Print Random Samples
        random_test_features, random_test_labels = tuple(zip(*random.sample(list(zip(test_features, test_labels)), n_samples)))
        random_test_predictions = sess.run(
            tf.nn.top_k(tf.nn.softmax(loaded_logits), top_n_predictions),
            feed_dict={loaded_x: random_test_features, loaded_y: random_test_labels, loaded_keep_prob_1: 1.0, loaded_keep_prob_2: 1.0,
                       loaded_is_training:False})
        display_image_predictions(random_test_features, random_test_labels, random_test_predictions)


test_model()
INFO:tensorflow:Restoring parameters from ./image_classification
Testing Accuracy: 0.8981408227848101

The following method about running TensorBoards in Google Colab refer to this stackoverflow answer.

Get TensorBoard running in the background. (Inspired by this answer.)

In [ ]:
LOG_DIR = '' # set this to your directory of tenosorboard log files, eg.'./tmp/log'
get_ipython().system_raw(
    'tensorboard --logdir {} --host 0.0.0.0 --port 6006 &'
    .format(LOG_DIR)
)
In [ ]:
! curl http://localhost:6006

Download and unzip ngrok.

In [ ]:
! wget https://bin.equinox.io/c/4VmDzA7iaHb/ngrok-stable-linux-amd64.zip > /dev/null 2>&1
! unzip ngrok-stable-linux-amd64.zip > /dev/null 2>&1

Launch ngrok background process...

In [ ]:
get_ipython().system_raw('./ngrok http 6006 &')

...and retrieve public url. (Source)

In [ ]:
! curl -s http://localhost:4040/api/tunnels | python3 -c \
    "import sys, json; print(json.load(sys.stdin)['tunnels'][0]['public_url'])"

If you run against ngrok rate limits, try to use localtunnel instead:

In [ ]:
# Install
! npm install -g localtunnel
In [ ]:
# Tunnel port 6006 (TensorBoard assumed running)
get_ipython().system_raw('lt --port 6006 >> url.txt 2>&1 &')
In [ ]:
# Get url
! cat url.txt

Bonus: let accuracy over 90%

優化 CNN 的方法

  • 改善 Gradient Vanishing 問題:
  • Xavier Initialization → He Initialization
  • Batch Normalization
  • Selu (Self-Normalizing ReLU, SNN)
  • 讓 Dropout 比例不一:Differential Dropout
  • 隨機打亂資料:Random Shuffling
  • 考慮模型複雜度的懲罰值:L2 Regularization
  • Learning rate decay
  • NIN
  • Data Augmentation

使用 Xavier Initialization + Selu 讓 Accuracy 提升至 79%

上週的結果,使用 Selu 的效果最優,但是當層數增加,我發現 BN 其實還是比較好。

Final CNN Architecture

本實驗最終的 CNN 架構,共有 9 層 convolution layers 。

CNN Layers - NIN (Network in Network)

這裡顯示模型的內部層級細節,其中,我採用 NIN (Network in Network) 這種改進 CNN 的新架構。

NIN (Network in Network) 主要有兩大改進

1. Mlpconv (multilayer perceptron convolution)

  • 在 conv layers 中間加上多層的 fully connected layers。
  • 實作上使用 1x1 conv (又稱 cascaded cross-channel pooling, CCCP)。
  • 提高 conv layer 的非線性感知能力。

2. Global Average Pooling

  • 對整個 feature map 取平均值,直接作為output layer的結果。
  • 取代 fully connected layers ,大幅減少 parameters 。

使用 Tensorboard 視覺化的結果調整 Hyperparameters

1. Choosing Learning Rate

I make the learning rate decays over 81 epochs and 122 epochs down to 1/10 of the initial learning rate. So, at about 81th epoch, there is an abrupt increasing!

結果顯示當 learning rate 為 0.001 時,收斂最快,準確率也最高。而 learning rate decay 可以在模型學完粗略的部分之後,以更小的 learning rate 學習更到細膩的部份,可由圖中約 81 epoch 時的突然變化得知的確有效。

2. Choosing Batch Size

結果顯示當 batch size 對於模型的準確度影響不大。大的 batch size 因為一次看的資料多,學習穩定,不易產生訓練震盪,且訓練較快,但是比較占記憶體;小的 batch size 每次只看一小批資料,在訓練過程中較不穩定,且較不吃記憶體,卻需較久的時間。

權重分布

Data Augmentation

我使用 imgaug 這個 python package 做 data augmentation 。

我先將 5 份 batch data (10000 images/batch data) 做 random shuffling 並切出 90% 作為 train batch data (9000 images/train batch data) ,並將 5 份剩下的 10% 集合成 validation data (5000 images/validation data) ,再將 5 份 train batch data 做 data augmentation ,每張 image 擴增 9 份,總共多產生 5 份 augmentation train batch data (81000 images/aug train batch)。

最後將 train batch data 與 augmentation train batch data 合併成 100000 images/batch ,然後隨機切成 10 等份做為新的 train batch data ,餵入模型訓練。

而其中我所使用到的 data augmentation 方法如下表:

產生出的圖片如下所示:

Result

1. Validation Accuracy

2. Training Loss

3. Weights Distributions and Histograms

Final Model and Testing Accuracy

最後我選擇:

  • Batch size : 128
  • Initial learning rate : 0.001
  • Epochs : 164